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SANTRAUKA 

Destymas aukstojoje mokykloje negali buti nepriklausomas nuo 
aukstosios mokyklos politikos. Destymas ir jo kokybe is dalies 
laikoma aukstajam mokslui neabejingq zmoniq veikla. Discipli- 
nq aukstojoje mokykloje sudetingumas nepateisina abejingu- 
mo studentq, taip pat visuomenes, valstybes, aukstosios mo- 
kyklos administracijos bei destytojq poreikiams. Destymas -tai 
ne vien tik bendravimas, tai ir galimybiq jgyti iguzius, supratimq 
ir gebejimq atkakliai ir istvermingai siekti tolimesniq tikslq suda- 
rymas, nors kai kurie is tq, kuriems sios galimybes teikiamos, 
ne visada sugeba suprasti tuos, kurie tokias galimybes teikia. 
Siandienine aukstosios mokyklos politika retai atspindi mark- 
sistines, industrines, pilietines ir antikarines praeities realijas. 
Siandieninp bendrqjq politikq lemia globalus ekonominiai po- 
kyciai, skatinantys studentus ieskotis darbo ne arciau namq, o 
labiau ekonomiskai issivysciuqsiq miestq irsaliqtechnologiniuo- 
se bei verslo centruose. Destymo mikropolitika ir toliau didzia 
dalimi lemia tai, ar destytojas gaus destyti norimus kursus. Ge- 
ra destymo kokybe priklauso nuo pasirinkimu, kuriuos studen- 
tams reikia daryti gyvenime, ne tik akademines specializacijos 
atveju, bet ir pasirenkant tai, su kuo jie gers kavq ar kokiomis 
vertybemis vadovausis, siekdami savo karjeros. 

Siame straipsnyje pateiksime argumentus jrodancius, kad jver- 
tinimas turi buti daugialypis. Tik truputis demesio bus skirta des- 
tytojo bruozams ir destymo stiliams, nors tai taip pat labai svar- 
bu. Nesutelksime demesio ir j studentq studijq rezultatus. Ak- 
centuosime tik destytojo pareigq (McConney ir kt., 1995). Rei- 
kalausime jvertintojo asmeninio nuovokumo ir jtikinesime, kad 
destytojas turi buti laikomas akademines bendruomenes nariu. 
Pabaigoje kaip savo politinq pozicijq pateiksime personalo jver- 
tinimo rezultatus, supriesindami juos su standartizuotu desty- 
mu aukstojoje mokykloje. 

PAGRINDINiy SAVOKy APIBREZIMAI 

• Aukstasis moks/as - visq lygmenq studijos po vidurines mo- 
kyklos, kol jgyjamas formalus laipsnis. 1 

• Destymo kokybe- apibudina destytojo darbo teigiamus ir nei- 
giamus bruozus, gerus ir blogus ypatumus, privalumus ir truku- 
mus. 2 

• Akademinio personalo jvertinimas- destymo ir kitq mokyklos, 
kolegijos ar universiteto akademinio personalo nuopelnq ar ver- 
tes nustatymas. 3 

• Destytojo pareigos- Michael Scriven sukurtas jvertinimo me- 
todas (1988) 4 . 

• Kompetentingumas - asmens demonstruojamas gebejimas 
atlikti, vykdyti, t.y. tureti ir valdyti zinias, jgudzius ir asmenines 
savybes, siekiant patenkinti tarn tikros konkrecios situacijos ke- 
liamus reikalavimus. 5 


ABSTRACT 

Campus teaching is not independent of campus politics. 
Quality of teaching is partly a function of who cares. The 
complexity of the disciplines taught is not justification for 
indifference to the needs of students — and the needs of the 
public, and the state, and the campus administrative offices, 
and the instructors. Teaching is not merely a matter of com- 
municating but also of providing opportunity to gain skills, 
understandings, and capacity to persevere, some of which 
will be outside the comprehension of some of those who 
teach. 

Campus politics today seldom mirrors the Marxist, indus- 
trialist, civil rights and anti-war battles of the past. Today’s 
macro-politics are driven by global economic causes, par- 
ticularly the drawing of students away from work in their home 
communities to the technological and business centers of the 
more economically developed cities and countries. The micro- 
politics of teaching continues to be largely a matter of who 
gets to teach the courses they want to teach. Good quality of 
teaching requires attention to the choices in the lives of stu- 
dents, not only in academic specialization but choices about 
with whom they will have coffee and to what values they will 
commit their careers. 

In this paper, we support multiple evaluative efforts. We urge 
some but only a small amount of attention to traits and styles 
of instructors. We only slightly notice student outcomes. What 
we emphasize is instructor duty (McConney et al . , 1995). We 
call for personal judgment of the evaluator and urge that the 
instructor be viewed as a member of a teaching community. 
Finally, partly as a political view, we oppose using personnel 
evaluation to standardize campus teaching. 


DEFINITIONS OF KEY WORDS 

• Higher education: all education beyond the secondary level 
leading to a formal degree. 1 

• Teaching quality: refers to teacher strengths and limitations, 
goodness and badness, merit and shortcomings. 2 

• Faculty evaluation: judging the value or merit of instruc- 
tional, or other academic staff in schools, colleges, or uni- 
versities. 3 

• Teacher duties: approach to evaluation developed by Mi- 
chael Scriven (1988) 4 . 

• Competence. Vne individual’s demonstrated capacity to per- 
form, i.e., the possession of knowledge, skills, and personal 
characteristics needed to satisfy the special demands or 
requirements of a particular situation. 5 
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jVADAS 

Destymas aukstojoje mokykloje jvertinamas neformaliai 
irformaliai. Dabartine forma/aus aukstojo mokslo jverti- 
nimo bukle, matyt, visose salyse nera gera - ji pernelyg 
supaprastinta ir nenuosekli. Destytojq darbas yra sude- 
tinga veikla politineje aplinkoje, bet daugelyje vertinimo 
procedGrq neatsizvelgiama j tai, kad destytojo atsako- 
mybe jvairiapuse ir priklauso nuo situacijos specifisku- 
mo. Galbut taip bus visada; zinoma, kad technologiniq 
sprendimq kaina yra bauginanti, taciau destymo jvertini- 
mas gali buti atliekamas geriau. 

Destymo jvertinimas neatskiriama visos institucijos 
veiklos jvertinimo dalis. Platus ir efektyvus destymo jver- 
tinimas reikalauja kritisko tyrimo, kur butq atsizvelgiama 
j institucijos tikslus, studentq auditorijq, administracines 
veiklos organizavimq, studijq turinj ir studentq pasieki- 
mus bei studijq programq poveikj valstybei ir visuomenei 
(Shulman 1986; Cave ir kt. 1988; Lave ir Wenger 1991; 
Shinkfield ir Stufflebeam 1995). Destymq tinkamai jver- 
tinsime tik visq siu politiniq veiksniu kontekste, o jei siq 
veiksniq netirsime, destymo jvertinimas bus neisbaigtas 
ir daznai nepagrjstas. 

Kaip ir destymas, jvertinimas yra informacija pagristq 
sprendimq priemimo procesas. Kaip teigiama Personalo 
jvertinimo standarte (1988), turi buti pasitelkiamos jvai- 
rios informacijos rinkimo procedures, stebejimas ir situ- 
acijq jvertinimas. Studijq dalyko jvertinimui gali buti tai- 
komi kiekybiniai bei naturalistiniai tyrimq metodai. 

Siame straipsnyje aptarsime daugialypio jvertinimo 
pastangas. Nedaug demesio bus skirta destytojo savy- 
bems ir destymo stiliams, nors tai labai svarbu. Dar 
maziau demesio kreipsime j studentq rezultatus. Akcen- 
tuosime tik destytojo pareigas (McConney ir kt., 1995). 
Reikalausime asmeninio jvertintojo nuovokumo ir jtikine- 
sime, kad destytojas turi buti laikomas akademines bend- 
ruomenes nariu. Pabaigoje savo esminq pozicijq is da- 
lies supriesinsime su standartizuotu destymo jvertinimo 
taikymu aukstojoje mokykloje. 


1 

PAVOJAI 

Dauguma profesoriq ir destytojq (kaip ir kito pobudzio 
darbuose) formalu jvertinimo traktuoja kaip gresmq. Ir 
tarn turi pakankamq pagrindq. Nepaisant to, ar jvertini- 
mas pagrjstas ar ne, zmones gali buti jskaudinti. jverti- 
nimas, ko gero, nebus toks skausmingas destytojq tiks- 
lams ir gabumams, kaip to noretqsi. Jis tikriausiai la- 
biau deres prie aukstojo mokslo institucijos tikslu ir struk- 
turos (Meyer, Scott ir Deal, 1981), ir netgi deres prie jq 
gana netobulai. Ypac uzmaskuotai jvertinimas kartais 
panaudojamas priekabiavimo ar cenzuros tikslais. Tai, 
kq destytojas turi pasakyti, turetq buti jvertinta, bet jver- 
tinimu pagrjstas veiksmas neturetu pazeisti akademines 
laisves. 6 jvertinimas turetq buti atliekamas tik tais atve- 
jais, kai galima jrodyti, kad formalus destytojo jvertinimo 
procesas pagelbes studijoms, o ne padarys zalq. Sj da- 
lyko jrodyti - svarbi administracijos pareiga. Vertinimas 
neturetu kelti pavojq harmoningiems ir pagarbiems aka- 
deminio personalo santykiams ir studijq aplinkos koky- 


INTRODUCTION 

Campus teaching is evaluated informally and formally. 
The current state-of-the-art of formal evaluation of col- 
lege teaching in perhaps all countries is poor; it is simp- 
listic and inconsequential. Faculty work is a complex 
enterprise in a political milieu but most assessment pro- 
cedures are insensitive to its broad responsibility and 
situationality. Perhaps it will always be so; certainly the 
price of technological solution is daunting; but the 
evaluation of teaching can be done better. 

The evaluation of teaching is an inseparable part 
of the evaluation of the institution. A broad and effec- 
tive evaluation of teaching requires critical study of ins- 
titutional goals, classroom environments, administra- 
tive organization and operations, curricular content, 
student achievement, and of the impact of programs 
on state and society (Shulman, 1986; Cave etal., 1988; 
Lave & Wenger, 1991 ; Shinkfield & Stufflebeam, 1995). 
Teaching can be judged properly only in the context of 
these political factors — and if no effort is made to study 
them, the evaluation of teaching will be incomplete and 
often invalid. 

Like teaching, evaluation is a process of judgment 
based on information. As described in The Personnel 
Evaluation Standards (1 988), various kinds of informa- 
tion gathering procedures, observers, and situations 
should be used. Together, quantitative and naturalistic 
research methods can help discipline the appraisal. 

In this paper, we support multiple evaluative efforts. 
We urge some but only a small amount of attention to 
traits and styles of instructors. We only slightly notice 
student outcomes. What we emphasize is instructor du- 
ty (McConney et al . , 1995). We call for personal judg- 
ment of the evaluator and urge that the instructor be 
viewed as a member of a teaching community. Finally, 
partly as a political view, we oppose using personnel 
evaluation to standardize campus teaching. 


1 

RISKS 

Many professors and instructors (as with people in all 
kinds of work) consider formal evaluation a threat. And 
with reason. Whether the evaluation is valid or invalid, 
they may get hurt. The evaluation will probably be less 
sensitive to their aims and talents than anyone would 
like. It will be more attuned to campus institutional aims 
and structures (Meyer, Scott and Deal, 1981), and even 
to those quite imperfectly. More insidiously, evaluation 
sometimes is used to harass or censor. What a teacher 
has to say should not go unevaluated but action based 
on evaluation should not violate academic freedom. 6 
Only when it can be demonstrated that the capacity for 
education will be helped more than hurt by the formal 
processes of teacher evaluation should they occur. The 
burden of demonstration rests with administrators. It 
should be a stern obligation. The harmony and respect 
of the faculty, and thus the quality of classroom learn- 
ing environments, should not be put at risk just because 
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bei, nes destymo jvertinimas kai kuriuos dalykus gali 
padeti pagerinti. 

Realiame pasaulyje jvertinimo metu surinkta informa- 
cija toliau apdorojama, sis procesas yra ir politinis, ir ana- 
litinis. Geri duomenys retai kadatiesiogiai issprendziaeg- 
zistuojancias problemas, is tiesq jie tik daznai paskatina 
politines manipuliacijas (Fetterman ir Pitman, 1986). Kol 
nera patyrimo ir palankiq politiniu salygLj, jvertinimu pa- 
grjstq informacijqdestymui pagerinti turetume naudoti at- 
sargiai. Tai nereiskia, kad destymas neturi buti jvertintas. 
Jis privalo buti jvertintas, tad sis procesas vyks. Taciau 
turetume ismokti tai daryti geriau. jvertinimas turi buti pa- 
grjstas katedros ir universiteto bendruomenes realijomis, 
o ne tik destymo ideologijomis ir destomam dalykui jpras- 
tomis tradicijomis. 

Kiekvieno aukstosios mokyklos destytojo kvalifikaci- 
ja ir pareigu atlikimas jvertinami siekiant maziausiai ketu- 
riq tikslu: 

a) gauti duomenis, kad butij atskleisti privalumai arba 
istaisyti trukumai; 

b) padeti atrinkti auksciausiq kvalifikacijqturincius des- 
tytojus naujiems uzdaviniams jgyvendinti ar islaikyti rei- 
kalingiausius asmenis jau igyvendinancius tas uzduotis; 

c) skatinti destytojq tobulinti profesinq kvalifikacijq; 

d) prisideti prie katedros ir viso universiteto veiklos 
tolesnio gerinimo. 

Siq keturiq tikslq siekimo procesas vyksta vienu me- 
tu, taciau vienas kitam ir kliudo. Duomenys siekiant vie- 
no tikslo gali buti netinkamai panaudoti kitu tikslu, pvz., 
savanoriskai pasiulyti duomenys, kuriais siekiama page- 
rinti personalo veiklq gali buti neteisingai panaudoti at- 
skaitomybei. Norint pasiekti, kad jvertinimas butq gera- 
noriskas, tikslai, kontekstas, budai ir pasekmes turi buti 
suvokiami kaip sisteminga visuma. 

2 

DESTYMO APZVALGA 

1965 m. Lee Cronbach ir Goldine Gleser isskyre dvi sq- 
vokas: paskyrimas arba jdarbinimas fangl. placement) ir 
atrinkimas arba atranka fangl. selection). Jei jvertiname 
jau dirbantj akademinio personalo narj, tikedamiesi, kad 
po jvertinimo jis ir toliau liks akademines bendruomenes 
nariu, tokj jvertinimo vadiname paskyrimu arba atitikimu 
uzimamoms pareigoms. Sio jvertinimo tikslas yra geriau 
suvokti destytojo gabumus irtrukumus. Kreipdami demesj 
j abu aspektus, siekiame pakoreguoti destymo, pagerin- 
ti darbo salygas bei uztikrinti geresnj darbo atlikimo- Tai 
dazniausiai smulkus, nors kartais gali pasitaikyti ir rim- 
tesniu korekcijq. jvertinant atitikimo pareigoms demesys 
koncentruojamas j busimqatsakomybq uz destymo ir dar- 
bo turinj. 

Atrankos atveju, t.y. atrenkant vieno kandidato is dau- 
gelio ilgalaikiam jdarbinimui, tiesiogines aplinkybes nera 
tokios svarbios. Toliau musq straipsnyje bus analizuoja- 
mas atitikimo pareigoms, o ne atrankos jvertinimas. 

Vieno akademinio personalo nario formalus ar ne- 
formalus lyginimas su kitais yra trumparegiskas poziu- 
ris. Destoma tarn tikroje specifineje aplinkoje. Kiekvie- 
no vertinimo standartai turi remtis specifine situacija, 
dabartinemis ir busimomis didaktinemis bei politine- 


further evaluation of teaching might improve some 
things. 

In the real world, what is done with evaluation infor- 
mation gathered is as much a political as analytic pro- 
cess. Good data seldom lead directly to problem-solv- 
ing, in fact they often lead to political manipulation (Fet- 
terman and Pitman, 1986). Until we have the know-how 
and political facility for improving teaching based on 
evaluative information, we should proceed cautiously. 
This is not to say the teaching should not be evaluated. 
It will be evaluated. It must be evaluated. But we should 
get better at doing it. Doing it should be based on the 
realities of the department and campus community, not 
only on ideologies of teaching and customs of the dis- 
ciplines. 

For instructor evaluation, for the appraisal of qualifi- 
cation and performance of the individual college teacher, 
we speak of at least four aims: 

a. providing data for the reward of merit and the cor- 
rection of shortcoming; 

b. aiding selection of the best qualified persons for 
new assignments and retention of the most needed in 
existing assignments; 

c. assisting in continuing professional education for 
instructors and, 

d. contributing to further understanding of the opera- 
tion of the department and college as a whole. 

These four purposes regularly coexist but they get in 
each other’s way. Data for one aim may inappropriately 
be used for another aim; e.g., data volunteered for staff 
improvement may wrongly be used for accountability. The 
purposes, the contexts, the techniques, and the conse- 
quences need to be seen as a systemic whole if the evalu- 
ation is to be beneficial. 


2 

VIEWING TEACHING 

In 1965, Lee Cronbach and Goldine Gleser made an im- 
portant distinction between placement and selection. If 
we are evaluating someone already a faculty member with 
expectation of remaining so, we may call it placement. 
From that evaluation we hope to get a better idea of ta- 
lents and shortcomings. Noting both, we consider ad- 
justing the teaching situation to improve working condi- 
tions and performance — usually a minor adjustment, but 
sometimes much more. In placement evaluation, we con- 
centrate on the anticipated responsibility of instruction 
and the work context. 

For selection, that is, selecting one of many candi- 
dates for a long-term position, immediate circumstances 
are not so important. In most of the following, our dis- 
cussion will be on placement rather than selection. 

One of the myopias in teacher evaluation is to com- 
pare, formally or informally, one faculty member with 
others en masse. Teaching occurs in particular situations. 
The standards for each evaluation should be based on 
the particular situation, the present and coming peda- 
gogical and political circumstances, according to the re- 
levant reference groups, and as to the contextual pur- 
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mis aplinkybemis, atsizvelgti j tiesiogiai susijusias cha- 
rakterizuojamas grupes ir kontekstinius tikslus. Pirmiau- 
sia reikia atsizvelgti j jvertinamo destytojo situacijos uni- 
kalumq. 

Pateiksime tris standartines skales (nuo blogiausio 
vertinimo iki geriausio): 1-oji skale - vertinamo destymo 
kokybe (kaip tam tikri zmones suvokia destymq, - tiesio- 
giai, nelyginant su kitais destytojais); 2-oji skale - ar ga- 
letq sis destytojas dirbti geriau tokioje situacijoje ir kiek 
geriau; ir 3-oji skale - kaip desto kiti panasiq disciplinq 
destytojai (vietiniai ar kurie nors kiti). Vertinant jau dir- 
banciij destytojq atitikimq ir destymo pagerinimo galimy- 
bes papildomas demesys turi buti kreipiamas j 2-qjq skalg. 
Sioje skaleje vertinama, kiek destytojas gali dirbti geriau- 
siai ir blogiausiai, atsizvelgiant j didaktines ir politines dar- 
bo sqlygas, ypac j tas sqlygas, kurias akademines ben- 
druomenes nariai mazai gali keisti. Turime realiai vertinti 
situacijq, sprgsdami, kiek galime pagerinti darbq ir kiek 
te/'kainuos. Akivaizdu, kad diapazonas tarp „blogiausio“ 
ir „geriausio“ (tam tikrame specifiniame kontekste) ne- 
gali bDti tiksliai apibreztas. Bet net apytikriai nustatant, 
toks vertinimas yra reikalingas, kad akademinis perso- 
nalas tobuletq, o destymo kokybe geretij. 

2.1. VISl,) GERIAUSIAS DESTYTOJAS? 

Negalima jsivaizduoti vieno idealaus destytojo. Net siau- 
riausioje studiju programoje studentai turi ismokti daug 
dalyku atlikti techniskai, eksperimentiskai, politiskai. Kad 
ir koks standartizuotas studiju turinys butu, kiekvienas 
destytojas destys skirtingai. Kritinj mqstymq akcentuo- 
jantis destytojas retai mobilizuos veiklai. jvairiq gabumq 
reikia ne todel, kad geri destytojai nedesto placiai, bet 
del to, kad destytojai paprastai kuria gana pastovias mo- 
kymosi situacijas. Tam, kad butu sukurtos rezultatyvios 
jvairiu rusiu mokymosi situacijos, reikalinga destytoju 
jvairove. 

Destymo kokybes jvertinimas reikalauja detaliq ziniq 
apie atliekamq darbq ir vykdomas pareigas. Dazniausiai 
niekas issamiai neaprasineja, kq destytojas is tikrqju vei- 
kia auditorijoje. Pastangos uzrasineti tokio pobudzio in- 
formacijq butu didele, net nepakeliama nasta, bet trumpi 
aprasai ir vinjetes yra jprastas dalykas vertinant destyto- 
jo darbq. 

Profesoriai, destytojai ir netgi asistentai auditorijoje 
yra gana autonomiski, taciau vis del to jie nuolat veikia 
isvien. Turetu buti akivaizdu, kad vieno asmens destymo 
jvertinimas priklauso nuo zinojimo, kokiais gabumais pa- 
sizymi kiti akademinio personalo nariai. Kitaiptariant, rei- 
kia jvertinti ne tik individually destytojo, bet ir akademinio 
personalo grupes. Apie tai kalbesime veliau. 

(vertinant destymq ir patj destomq dalykq reikia zinoti, 
k^ tuo metu dar desto kiti, taip pat ir tai, kas buvo ir kas 
dar bus destoma. Tam reikia suprasti temas ir jq patei- 
kimo sek^. Toks destytojas supranta, kaip vystosi stu- 
dento mqstymas. Efektyviai dirbantis destytojas pade- 
da studentams mokyti vienas kitq. Atskirq destytoju jver- 
tinimas nebus issamus, jei nepasidomesime, kaip des- 
tytojas bendradarbiauja su kitais akademinio persona- 
lo nariais bei kokie yra kitq destytoji) privalumai ir truku- 
mai. Beveik kiekvienas destytojas yra vienos ar keliq gru- 
piu narys, o kiekviena grupe turi savo didaktinp ir polli- 
ng realybes. 


poses. Reference should be made primarily to the unique 
situation of the instructor being evaluated. 

We think of three reference scales (each running, 
say, from abominable teaching to superb): Scale #1. 
the quality of this teaching (as certain people perceive 
it to be — without immediate reference to other instruc- 
tors); Scale #2. how good this teaching might be (for 
this instructor) in this setting; and, Scale #3. how well 
other similar instructors teach (locally or wherever). For 
placement and improvement of teaching by faculty 
members already hired and not easily reassigned, ex- 
tra attention needs to be paid to Scale #2. That is, to 
the range between the best and the worst each instruc- 
tor could be — given the pedagogical and political con- 
ditions of work here, especially the conditions that can 
be little altered by the faculty. We need to be realistic 
about the room to improve and the costs involved in 
being this good. Of course, the range of “worst pos- 
sible” to “best possible” (for the particular context) 
cannot be stated precisely. But even roughly con- 
ceived, that estimate is needed for appraisal leading 
to staff development and the improvement of teaching 
quality. 

2.1 . A UNIVERSALLY BEST TEACHER? 

We should not think of a single ideal teacher. Even in the 
narrowest training program, students have many things 
to learn, technically, experientially, politically. However 
standardized the curriculum, different instructors will 
teach different things. The instructor who emphasizes 
critical thinking seldom emphasizes mobilization for ac- 
tion. The need for diverse talents is not because good 
teachers do not teach broadly, but because teachers are 
consistent in the kinds of learning situations they create. 
Dissimilar teachers are needed to create a useful range 
of learning situations. 

To evaluate the quality of teaching requires a detailed 
knowledge of the work being done, the duties fulfilled. 
Records of what an instructor actually does in the class- 
room are seldom kept. An effort to keep such records can 
be burdensome, even oppressive, but brief descriptions 
and vignettes are common to the best assessment efforts. 

Professors, instructors, even teaching assistants, have 
considerable autonomy in the classroom, yet they regu- 
larly act in concert. It should be obvious then that evalu- 
ating one person’s teaching depends on recognizing what 
talents are already available among other members of 
the faculty. In other words, one needs not only evaluate 
individual instructors but also teams of the teaching fa- 
culty. We will speak more of this later. 

Evaluating teaching, and teaching itself, requires an 
understanding of what else is being taught by others cur- 
rently — as well as what has been taught and what is still to 
come. It requires an understanding of topics and the se- 
quences of presentation. An effective teacher compre- 
hends how the student mind can develop. An effective 
teacher helps students teach each other. An evaluation of 
individual instructors is not complete without considering 
how the teacher works with others of the faculty, and the 
strengths and weaknesses of those others. Almost every 
teacher is a member of one or several groups, and each 
group has its own pedagogical and political realities. 
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2.2. DESTYMO KRITERIJAI 

Manoma, kad ivertinimas grindziamas kriterijais, apibudi- 
nanciais tam tikrus rezultatus, parodancius keletq savybiq. 
Tomis savybemis remiantis ir daromi sprendimai apie gerq 
ar blogq destymq. Detalus kriterijq isaiskinimas pateikiamas 
arba priemus sprendimq arba pries jo priemimq, bet krite- 
rijai paprastai nustatomi visada, jvertinant bet kq. Egzistuo- 
ja daugybe kriterijq, pagal kuriuos akademinis personalas 
gali buti jvertinamas (Dunkin ir Biddle, 1974). Kai kriterijai 
grindziami studentu egzaminu rezultatais, gali atsirasti neri- 
mq kelianciq prielaidq del destymo priezascciq ir pasek- 
miu, todel daznai siekiama apriboti destymo turinj ir tirti tik 
tuos veiksnius, kuriuos galima ismatuoti. Prie sios minties 
vel grjsime poskyryje apie atskaitomybg. 

Kad ir koks ilgas kriterijq sqrasas butq, nejmanomasu- 
daryti kriterijq rinkinio, kuris tiktq visoms destymo situaci- 
joms apskritai. Be to, gauti auksti rezultatai pagal visus 
kriterijus dar nerodo, kad destytojas visais atvejais dirba 
labai efektyviai. O pernelyg auksti rezultatai, gauti pagal 
kokj nors vienq kriterijq, gali rodyti, kad „to gero per daug”. 7 
Trukumq priezastys buna jvairios. Tam, kad butq surinkta 
issamesne informacija, ne pavirsutiniski gero destymo ko- 
kybes jrodymai, reikalinga jvairiq rusiq informacija, atspin- 
dinti jvairias situacijas ir paremta jvairiais saltiniais. jvertinti 
remiantis vienu kokiu nors instrumentu ar pasitikint tik vie- 
nu autoritetu, pvz., Madeline Hunter 8 (Amidon ir Hunter, 
1966) ar Howard Gardner (1983), bGtq trumparegiska. 

Formalus destymo jvertinimas daznai remiasi ilgu kri- 
terijq sqrasu, pvz., dalyko zinios, studentq kontroles efek- 
tyvumas ir destymo planq kokybe (Braskamp ir Ory, 
1994). Sie kriterijai retai kada derinasi su efektyviu desty- 
mu. Jie tik rodo destytojo savybes, kuriomis akademinio 
personalo jstaigos valdzia zavisi, taciau tokie kriterijq sq- 
rasai daug kur laikomi teisetais. Tai ypac rysku tais atve- 
jais, kai reikia objektyviai atrodanciq procedurq paauksti- 
nant ar siekiant apginti status quo. 

Kriterijq sqraso taikymq reglamentuoja taisykles, taciau 
jq ne visada paisoma. Suma ar vidurkis (tiriant visus klausi- 
mus ar apklausiant visus destytojus) retai turi prasmg ar yra 
pagrjsti. Net jei taikomi tinkamai, jvertinimo kriterijq sqrasai 
buna informatyvus bei naudingi tik tada, kai pasitelkiami ne 
vieni. Dauguma kriterijq sqrasq yra sqmoningai sukurti, ne- 
susieti su turiniu, apolitiski, jie skatina daryti nepagrjstus api- 
bendrinimus. jvertinant destymo kokybq, reikia atsizvelgti j 
tai, kq destytojas yra nuveikqs politiskai jautriose situacijo- 
se. Apie tokias situacijas sunku surinkti ger^ informacija, 
taciau jmanoma. Tai, kad panasi situacija pasitaike tik kar- 
tq, dar nesukuria pagrindo ignoruoti sj kritinj veiksm^. Krite- 
rijq sqrasai padeda mums nepamirsti kriterijq. Be to, aptar- 
sime aprasymq taikymo problemas. 

Studentai, destytojai ir administracija daznai nesutaria 
del vienodu kriterijq ir standartq. Prasomi jvertinti destytojo, 
studentai 9 linkg akcentuoti asmenybes bruozus; kolegos, 
fakulteto nariai linkg akcentuoti biciulystp ir politinj lojalu- 
m^; administracija zavisi paklusnumu. Ir paciose grupese, 
zinoma, buna nesutarimu. Negalima tiketis, kad tokie skir- 
tingi poziuriai bus vienodi: kiekviena akis kokybp mato sa- 
vaip. Labai svarbi studentq poziuriq jvairove. Kiekvieno ben- 
dradarbio poziuris taip pat turi didelp svarbq. Jvertinimo tiks- 
las turetq buti nesulaukti vieningo reitingo ar charakterizavi- 
mo (Doyle, 1982, p. 27), bet issiaiskinti vairius destymo ko- 
kybes aspektus, is dalies remiantis tuo, kaip destymo pro- 
ceso dalyviai juos suvokia. 


2.2. CRITERIA FOR TEACHING 

Evaluation is usually thought of as based on criteria, with 
certain descriptive scores indicating more or less of quali- 
ties, then drawing forth a judgment of goodness or bad- 
ness. The judgment actually may follow or precede the 
explication of criteria, but criteria usually can be identified 
when anything is evaluated. The criteria by which teaching 
faculties are evaluated are numerous (See Dunkin and 
Biddle, 1974, for example). When the criteria are based 
on student examination performances, a troublesome pre- 
sumption may be made about cause and effect of tea- 
ching and a step often is taken toward reducing the con- 
tent of teaching to what can be measured. Our section on 
accountability will bring up this issue again. 

Long as the lists of criteria may be, a set cannot be 
found that adequately fits teaching situations in general. 
Furthermore, high marks on all criteria do not indicate the 
most valuable instructor for all situations. And an excess 
of any good quality can be too much of a good thing. 7 
The ways to shortcoming are many. For something be- 
yond superficial indications of quality teaching, we need 
information of diverse types, relating to diverse situations, 
and drawn from diverse sources. To evaluate on the basis 
of any single instrument, or to rely on only a single autho- 
rity, such as Madeline Hunter 8 (Amidon and Hunter, 1966) 
or Howard Gardner (1983), will be shortsighted. 

The formal evaluation of teaching often relies on check- 
lists with criteria such as knowledge of subject matter, ef- 
fectiveness of student control and quality of lesson plans 
(Braskamp and Ory, 1994). Such characteristics are sel- 
dom highly correlated with effective teaching. What they 
announce is what authorities admire in instructors and such 
checklists are widely accepted as legitimate. This is true 
particularly when objective-appearing procedures are 
needed to gain promotion or protect the status quo. 

There are rules for the use of checklists, not always fol- 
lowed. The sums or averages (across items or across in- 
structors) are seldom meaningful. Such sums and averages 
have seldom been validated. Even when used properly, 
evaluative checklists provide impressions, useful but not 
good enough alone. Most checklists are deliberately made 
context-free and apolitical, inviting unwarranted generaliza- 
tion. Evaluating the teaching quality of instructors requires 
review of what they have done in politically sensitive situa- 
tions. Gathering good information on those situations is dif- 
ficult, but can be done. Just because it happened only once, 
for example, is not grounds for ignoring a critical act. Evalua- 
tion checklists help remind us of criteria. We will discuss the 
problems of using descriptions again. 

Students, instructors and administrators often do not 
agree on criteria and standards. When asked to evaluate 
an instructor, students 9 tend to emphasize personality 
characteristics; peer faculty members tend to emphasize 
camaraderie and political allegiance; administrators ad- 
mire compliance. Within groups, of course there is disa- 
greement. Such views should not be expected to con- 
verge: quality is seen differently through different eyes. 
Diversity in student views is important. Individual peer 
views are important. The purpose of evaluation should 
not be to get a single rating or descriptor (Doyle, 1982, 
p. 27) but to learn the multi-faceted quality of teaching, 
partly as perceived by the people involved. 
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ADMINISTRACINIS POZIURIS 

Destymo vadyba neefektyvi, jei neatliekamas destymo 
efektyvumo vertinimas. Geriausi ir blogiausi vertinimai 
gaunami tais atvejais, kai destytojq personal^ neforma- 
liai jvertina administracija. Vienais atvejais toks jvertini- 
mas nepastovus, kitais siekiama nesureiksminti kebliq si- 
tuacijq; toks vertinimas visada politinis, taciau jis visada 
reikalingas. Administracijos jvertinimas dazniausiai turi ne- 
formaliqatsiliepimqform^, pavyzdziui, katedros vadovas 
jvertina destytojq remdamasis savo intuicija, bet kai ima- 
ma kalbeti apie kq nors neigiamo, arba jei nuo tokio jver- 
tinimo priklauso paskatinimas ar destytojo uzmokescio 
padidinimas, arba destytojas uz kq nors apdovanojamas, 
tonas tampa formalus. 

Atrodo, kad administratoriai (Feldman, 1989), jvertinda- 
mi destytojq personal^, remiasi destytojo reputacija ir daly- 
vavimu katedros veikloje, pavyzdziui, priklausymu vairiems 
komitetams. jvertindami destytojus, administratoriai daznai 
vaidina du vaidmenis - teisejo ir instruktoriaus - o toks de- 
rinys retai naudingas ir jvertinimui, ir profesiniam tobuleji- 
mui (Genova ir kt., 1976). 

Subjektyvumas nera administracijos vertinimo proble- 
ms. Intuicija gali stebetinai gerai pasitarnauti. Uz destymq 
gerbiami destytojai daznai yra atidus studentq darbui. Ad- 
ministratoriai pernelyg akcentuoja studentu pasitenkinimq, 
nors daugelis is jq supranta, kurie studiju dalykai yra palan- 
kus studentq karjeros raidai. Daugumai studentq kokiu nors 
budu teikiama individuali pagalba. Bet labai mazai destyto- 
jq atleidziami uz destymo nekompetentingumq. Mazai kam 
is jq padedama pasitaisyti ir destyti geriau, net oficialios pa- 
stabos daromos retai. Patys destytojai daznai abejoja ad- 
ministracijos pateiktais atsiliepimais, bet dreba vien tik pa- 
galvojq, kad bet kokia busima „grieztesne sistema” taps 
pernelyg supaprastinta ir leidzianti greiciau bausti. 

j rinkq orientuotoje epochoje administratoriai vis daz- 
niau jtraukiami j politines-technines formos universiteto val- 
dymq, pernelyg daug imama kalbeti apie destymo efekty- 
vumo matavimus, kartais pateikiami sukiai apie pridetines 
vertes svarbq studentq karjerai. Daromos uzuominos apie 
studentq darbo ismatavimq, siekiant vertinti jgytas zinias ir 
gebejimus. Sitoks poziuris turi daugybq trukumu. To, kq 
studentai ismoko destomq kursu metu, negalima ismatuoti 
taikant siuolaikines testavimo priemones; 10 tik maza dalis 
isskiriamq pasiekimu yra tos disciplines destytojo nuopel- 
nas, o jtampa atsirandanti del matuojamq pasiekimq gali 
pakenkti destymo turiniui. Kadangi universitetq administra- 
cija susikure savo koncepcijq, apie atsakomybg uz duome- 
nu apdorojimo sistemq pateikim^, todel irtoliau lieka netik- 
rumas del rinkq, metodu ir personalo. Turbut nera tokios 
profesines ar destymo srities, kuri butq nekintama ir leistq 
su pasitikejimu nurodyti, kokios zinios ir gebejimai bus rei- 
kalingi ateities pasaulyje. Tokia neziniavercia destytojus buti 
atsakingus uz busimos kartos parengim^, taciau iki siol ne- 
nustatyta, kokiu pagrindu galima remtis vykdant efektyvaus 
destymo jvertinim^ standartizuotais vertinimo metodais. 

3.1. ASMENINIAI BRUOZAI 

Administratoriai, kurie pasitelkia formalaus destymo 
jvertinimo retorikq, remiasi kriterijq sqrasais ir skale- 
mis. Tik kai kuriems administratoriams svarbu nors kart- 
kartemis stebeti tai, kas vyksta auditorijoje. Personalo 


3 

THE ADMINISTRATIVE VIEW 

Management of teaching is not effective without assess- 
ment of teaching effectiveness. The best and the worst 
assessment we have is informal faculty evaluation by ad- 
ministrators. It is sometimes capricious, sometimes more 
aimed at minimizing embarrassment, always political, but 
always necessary. Administrative evaluation most often 
is informal review, such as that of a department head in- 
tuitively valuing an instructor, but moving into formality 
when something goes wrong, when promotion or an in- 
crement of pay depends on it, or when an award is to be 
made. 

Administrators (Feldman, 1989) appear to base fa- 
culty evaluation on the reputation and participation in de- 
partmental activities, such as committee service. Often 
when administrators evaluate instructors, they play both 
the role of judge and coach — a combination that seldom 
serves both evaluation and professional development well 
(Genova et al., 1976). 

The problem in administrative review is not subjecti- 
vity. Intuition can work surprisingly well. Instructors es- 
teemed for their instruction tend to be sensitive to what 
students are doing. Administrators over-emphasize evi- 
dence of student satisfaction but many of them under- 
stand which classrooms are good for career development. 
Most students are in some ways personally helped. But 
few instructors incompetent at teaching are dismissed, 
or helped to get better, or even officially noticed. The in- 
structors themselves have reservations about current 
administrative reviews but they tremble at the thought that 
any coming “more rigorous system” will be simplistic and 
punitive. 

Increasingly in a market-oriented era, administrators 
are caught up in a political-technical form of campus 
management that over-promises measurement of tea- 
ching effectiveness, sometimes expressed in slogans 
of value added to student careers. There is allusion to 
student performance measurement showing gain in tar- 
geted knowledge and skill. There are huge flaws in this 
approach. The important learning from courses cannot 
be measured with the current technology of testing; 10 
only a few gains discerned could be attributed to a par- 
ticular instructor, and the pressure for measurable per- 
formance waters down the curriculum. As campus ad- 
ministrations have conceptualized their responsibility in 
terms of spread-sheets, there continues to be uncertainty 
as to markets, methods and manpower. Perhaps there 
are no professional and learned fields so unchanging 
that one can indicate with confidence what knowledge 
and skill will be critical in tomorrow’s world. Such un- 
certainties do not allow instructors to escape responsi- 
bility for preparation of the coming generation but the 
grounds for evaluating teaching effectiveness by stan- 
dardized assessment are not being found. 

3.1. PERSONAL TRAITS 

Administrators who invoke the rhetoric of formal evalua- 
tion of instruction rely heavily on checklists and scales. 
A few call for occasional in-class observation. The per- 
sonnel evaluation and organization development litera- 
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jvertinimo ir organizacijos pletros tyrimuose pateikta 
daugybe jvairiq kriteriju. Vertinimo priemoniq atviruo- 
se klausimuose dazniausiai apibudinami specialus nuo- 
pelnai. 11 

Destymo jvertinimo tyrimuose pateikiama daug ste- 
bejimo formq, pvz., klasikinis dvipusis budingq savy- 
biu sqrasas (1 pav.), adaptuotas is Davido Ryans 
(1960). 


1 pav. Bipolio destytojo savybig apibudinimo pavyzdys 

(Saltinis: D. Ryans, 1960, p. 86. Panaudota gavus leidimg) 


Saliskas .... 

Objektyvus 

Autokratiskas .... 

Demokratiskas 

Nusisalin^s, abejingas .... 

Atliepiantis, jautrus 

Ribotas .... 

Suprantingas 

Siurkstus, grieztas .... 

Malonus, gerasirdis 

Nuobodus .... 

Skatinantis, jkvepiantis 

Stereotipiskas .... 

Originalus 

Apatiskas .... 

Judrus, gyvas, nuovokus 

Nedarantis jspudzio .... 

Patrauklus 

Vengiantis atsakomybes .... 

Atsakingas, pareigingas 

Nepatikimas .... 

Pastovus 

Lengvai sudirgstantis .... 

Susitvardantis, pasizymi savitvarda 

Abejojantis savimi .... 

Pasitikintis savimi 

Nelankstus .... 

Gebantis prisitaikyti 

Pesimistas .... 

Optimistas 

Nesubrendgs .... 

Visapusiskas 

Siauro mqstymo, .... 

nesugebantis prisitaikyti 

Placig paziuru 


Destytojq galima apibudinti kaip „saliskq“ ar „teisin- 
gq“, „autokratiskq“ ar „demokratiskq“, „nusisalinantj“ ar 
„atliepiantj“, „ribotq“ ar „suprantantj“, ir 1. 1. Tai asmens 
ypatumai. Taciau yra geru destytojq, kurie nepasizymi 
jokiomis asmenybinemis orientacijomis, o per didelis pa- 
nasiq savybiq turinciq destytojq skaicius vienoje kated- 
roje yra gana problematiskas dalykas. Isvardytos savy- 
bes gali buti naudingos diskusijoms apie destymq, bet 
neturetq buti fakulteto personalo jvertinimo demesio 
centras. 

3.2. DESTYMO STILIAI 

Destymo stiliai yra labiau susij§ su destymo kokybe nei 
asmeniniai bruozai. Gero destymo modeliai atitinka dau- 
gelj didaktiniq metodikq aprasq (Broudy, 1963). Kiekvie- 
nas destytojas savo darbe remiasi praeities patirtimi ir 
savo aspiracijomis. Destytojai gana vienodos nuomones 
apie tai, koks yra patenkinamas ir koks uzgaulus desty- 
mo budas. Kai universitetas ar kolega nori padeti desty- 
tojui susidoroti su iskilusiomis destymo problemomis, 
daznai diskutuojama ir patariama keisti destymo stiliq. 
Nors nera vienintelio teisingo destymo stiliaus, kuris tiktq 
visiems destytojams ar butij geras visose situacijose, vis 
del to jis atlieka svarbq vaidmenj gerinant destymo koky- 
bg. Zemiau (2 pav.) pateikiami ekspertu sukurti pasiuly- 
mai, kaip pagerinti destym^. Jie paimti is llinojaus uni- 
versiteto patarimu destytojams knygos (Office of Instruc- 
tional Resources, 1983). 


ture provide an abundance of criteria. With open-ended 
sections of rating instruments, special merit is to be de- 
scribed. 11 

The teaching evaluation literature includes ma- 
ny observation forms such as the classic bipolar list 
of attributes from David Ryans (1960) shown in Fi- 
gure 1 . 


Figure 1 . An example of bipolar traits descriptive of teachers 

(Adapted from Ryans, 1960, p.86. Used by permission) 


Partial 

.... Fair 

Autocratic 

.... Democratic 

Aloof 

.... Responsive 

Restricted 

.... Understanding 

Harsh 

.... Kindly 

Dull 

.... Stimulating 

Stereotyped 

.... Original 

Apathetic 

Alert 

Unimpressive 

.... Attractive 

Evading 

.... Responsible 

Erratic 

.... Steady 

Excitable 

.... Poised 

Uncertain 

.... Confident 

Inflexible 

.... Adaptable 

Pessimistic 

.... Optimistic 

Immature 

.... Integrated 

Narrow 

.... Broad 


It is possible for an instructor to be marked as: 
“partial” or “fair”, “autocratic” or “democratic”, “aloof” 
or “responsive”, “restricted” or “understanding”, and 
so on. These are personality characteristics. But good 
teachers are found having any personality orientation, 
and too many in a department of any one type is prob- 
lematic. Such traits can be useful for discussions of 
teaching but are not at the heart of good faculty 
evaluation. 


3.2. STYLES OF TEACHING 

More closely related to teaching quality than instruc- 
tor traits are the instructor’s teaching styles. The mo- 
dels of good teaching identify a number of pedagogi- 
cal approaches (Broudy, 1963). Each instructor draws 
from previous experience and aspiration. Instructors 
find quite a bit to agree with in terms of what is satisfy- 
ing and what is offensive teaching behavior. When a 
campus or a colleague wants to help an instructor with 
his or her teaching, the problems are discussed and 
suggestions made as to changes in style. Even though 
no one style is right for all instructors or all situations, 
style does have a lot to do with improving teaching 
quality. In Figure 2, suggestions have been drawn from 
a book of advice to instructors at the University of Illi- 
nois (Office of Instructional Resources, 1983), by ex- 
perts in improving teaching. 
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2 pav. Pasiulymai, kaip efektyviai skaityti paskaita 

(Saltinis: Akademinio personalo vadovas apie destymo jvertinimq. - 
Destymo isteklip tarnyba, llinojaus universitetas, 1989, p. 27. 

Panaudota gavus leidimg). 


Visada stenkites paskaitg pradeti ir baigti laiku. 
Pradekite parodydami siek tiek savo valdzios, 
kiek garsesniu nei paprastai balsu. 

Tai jums pades patraukti studenty demesj. 
jsitikinkite, ar visi studentai girdi 
jusij balsg ir jskaito jusy rastg. Paprasykite studenty, 
kolegy ar padejejo tai issiaiskinti. 

Kuo formalesne paskaita ir kuo daugiau studenty auditorijoje, 
tuo intensyvesni ir labiau apgalvoti turety buti jusy gestai, 
zodziy isryskinimas, tempo suletinimas ir pauziy darymas. 

Naudodami vaizding medziagg, jsitikinkite, ar ji isspausdinta 
pakankamai dideliu sriftu ir ar matoma galineje auditorijos eileje. 

JOsy destymo tempas turety buti gana letas, kad jusy studentai 
suspety skaityti/konspektuoti perteikiamg turinj. 

Nuolat palaikykite akiy kontaktg su savo studentais, 
sedinciais visoje auditorijoje. 

Pasirenkite daugiau medziagos, kad jos uztekty tuo atveju, 
jei baigsite daug anksciau nei tikejotes. 

Jusy vaizdine medziaga turety papildyti jusy paskaitg, 
o ne BUTI paskaita. Joje turety buti atskiros frazes, 
o ne ilgi sakiniai. Jei pateikiate apibrezimus, uzrasykite juos 
padalijamojoje medziagoje arba letai padiktuokite apibrezimg, 
jj kelis kartus pakartodami. 

jsirasykite savo kalbg arba paprasykite nufilmuoti, 
kad veliau galetumete patikrinti garsg, tempg, dikcijg, tarimg, 
bendrgjj suprantamumg, akiy kontaktg, gesty naudojimg 
ir isblaskomuosius judesius. 

Pasirinkite laikg jus nufilmuoti, kai skaitote paskaitg, 
ir pasitelkite specialist^ j pagalbg, 
kad pakonsultuoty, kai ziuresite. 


Figure 2. Suggestions for delivering an effective lecture 

(Adapted from Faculty Handbook on Teaching Evaluation, 
Office of Instructional Resources, University of Illinois, 1989, p 27. 

Used by permission). 


Always try to start and end on time. 

Start with a sense of authority, 
with your voice louder than usual. 

This will assist you in gaining their attention. 

Be sure that your voice can be heard, and your writing is readable, 
by all of your students. Have your students, a colleague, 
or an assistant give you feedback in this regard. 

The more formal the lecture and the larger your student 
enrollment, so also should your gestures, word emphasis, 
slowing of pace and use of silent pauses, 
be more intensified and deliberate. 

When using visual aids, be sure our print is large 
enough for back row visibility 

Your pace is slow enough so that your students 
can read/copy content 

Continually maintain direct eye contact with students in all 
sections of the room. 

Plan for more content in the event that you are done 
much sooner than you expected. 

Your visuals should augment your lecturing, not BE the lecture. 

Phrases rather than complete sentences should be used 
on the visuals. When definitions are necessary, provide handouts 
or slowly write/read the definition while repeating. 

Record your voice or videotape yourself as you lecture 
so that you can listen for pitch variation, pacing, volume, 
enunciation, pronunciation, general comprehensibility, eye contact, 
gesturing and distracting movement. 

Schedule a time to be videotaped as you lecture 
and have a specialist consult 
with you during a playback viewing. 


Tai geri patarimai. Daugelis minetu destymo situa- 
ciju buvo isnagrineta ir nustatyta, kad jos statistiskai ir 
empiriskai derinasi su efektyviu destymu. Taciau jos 
negali buti taikomos jvertinimui. Jei tie kriterijai butty 
net slaptai taikomi destymo jvertinimui, jie pazeistu aka- 
deminio personalo teises. Jei tie kriterijai butu specia- 
liai apibrezti destymo jvertinimui, jie atkreiptq demesj j 
tokj elgesj, kuris is tikrujij nera efektyvaus destymo 
pozymis, o tik koreliatyvi s^voka. Koreliatyvios s^vo- 
kos problem^ sunku suprasti, bet akivaizdu, kad iver- 
tinimas negali remtis vien tik statistiniu atitikimu. Kore- 
liacija tarp destytojo asmenybes savybiq ar destytojo 
elgesio ir gerai ismatuojamo destymo efektyvumo ne- 
ra nei galutine, nei priezastine. Kol nera nustatyta to- 
bula koreliacija, tol butij klaidinga bausti efektyviai dir- 
bantj destytojq todel, kad jo ar jos destymo stilius ne- 
jprastas, nesabloniskas (Scriven, 1988). Pavyzdziui, ty- 
rimai gali parodyti teigiam^ rysj tarp pagarbaus elge- 
sio su studentais ir to, kiek studentai mokosi. Kadangi 
nera tiksliai nustatyta, kad pagarba studentams yra 
destymo butinumas, tai destytojas turetu laisvai sprgsti 
pats, ar rodyti pagarbq, ar susilaikyti. Jvertinimas ne- 
gali buti pagrjstas mGsij spejimais, koks destymas bus 
efektyvus. Musq pareiga pagrjsti jvertinim^, kiek tas 
destymas efektyvus. 


This is good advice. Many of the teaching acts men- 
tioned have been studied and found to be correlated both 
statistically and experientially with effective teaching. But 
they should not be used for evaluation. Were they to be 
even-secretly considered criteria for the evaluation of 
teaching, it would violate the rights of the faculty mem- 
ber. Were they to be expressly defined as criteria for the 
evaluation of teaching, they would direct attention to 
behavior that is not actually a part of effective teaching, 
only a correlate. 

The issue of correlates is not easy to understand but it 
is certain that evaluation must not be based on statistical 
correspondence alone. Correlation among teacher traits 
or teacher behaviors and well-measured teaching effec- 
tiveness is not definitive or causative. As long as there is 
less than perfect correlation, it is wrong to penalize an ef- 
fective instructor because his or her style is unconventional 
(Scriven, 1988). Research might show, for example, posi- 
tive links between showing respect for students and the 
amount students learn - but, as long as respecting stu- 
dents has not been explicitly defined as a teaching obliga- 
tion, then the teacher should be free to give or withhold 
respect. Evaluation cannot be based on how effective at 
teaching we would predict instructors would be. Our obli- 
gation is to base the evaluation on how effective they are. 
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3.3. DESTYTOjg PAREIGOS 

Daugelis aukstosios mokyklos administratoriq destymo 
jvertinimui taiko studentLj apklausos metodus ir naudoja 
kriterijq sqrasus ir anketas, kuriuose apibudinama desty- 
tojo elgsena, rezultatai ir/ar pareigos. Reitingq sistemos 
buvo istobulintos iki tikro meno lygmens 12 irtapo bet ko- 
kios aukstosios mokyklos visapusio jvertinimo dalimi. Bet 
kad ir kaip placiai jos bGtq naudojamos, jq atsakymais 
negalima remtis kaip reprezentatyvia studentq populia- 
cijos imtimi net vienos grupes ribose. Tie duomenys yra 
svarbus tik tq studentq atzvilgiu, kurie atsake j klausimus. 
Kai kas gali tiketis daugiau ismokti is vadinamu ribiniu 
nei modaliniq respondentu. Standartizuoti kriterijq sqrasai 
ir anketos gali buti naudingos, bet svarbu pastebeti, kad 
tik vienas kitas is jq kreipia demesj j pareigas galbut del 
to, kad studentai turi mazokai progq stebeti, kaip desty- 
tojai atlieka daugelj savo pareigu. 

Tai, kq destytojai privalo atlikti auditorijoje ir uz jos 
ribq, ir turi buti jvertinimo demesio centras (Scriven, 1 974; 
Borich, 1977). Bet tai, kq jie privalo atlikti, yra labiau jp- 
rastas dalykas nei kontrakto ypatumas. Destytojai, nelai- 
mejq tarnybos kadencijos ar paaukstinirmo pareigose, 
daznai kaltinami nejautrumu, etikos pazeidimais ar ne- 
sugebejimu uzbaigti darbo, bet ne tuo, kad prastai atliko 
pareigas. O butent pareigos jausmq administratoriai, ko- 
legos, studentai ir pats destytojas turetq laikyti svarbiau- 
siu pagrindu formaliai jvertinant destymo kokybq. Nera 
sunku surasti pareigybiq sqrasus, pagal kuriuos destyto- 
jo darbas vertinamas. Michael Scriven (1988a, 1988b) su- 
kure destytoju jvertinimo metodikq, kuri vadinasi Parei- 
gybinis destytojo jvertinimas ( DBTE 'P. Jis nustate, ko- 
kias pareigas destytojas turi atlikti (3 pav). 

Svarbu atskirti tai, kq mes galime pavadinti tik geru 
bendrq pareigu atlikimu, o kq geru katedros darbuotoju. 
jvertindami destytojo darbq remiames abiem kriterijais, 
ir abiem atvejais galime diskutuoti, nes vienas aspektas 
numatytas kontrakte, o kitas yra jprastas, ritualinis, tarn 
tikra patirtimi pagrjstas sutarimas su administracija ir ko- 
legomis destytojais. Aptardami destytojo atsakomybg ir 
jo pazangq, administratoriai daznai buna nusistatq savo 
poreikius ir lukescius, pvz., destytojq susirinkimu lanky- 
mas, jvairiu formq, dokumentu pristatymas laiku, aukstes- 
niq pazymiu (infliacijos) rasymo isvengimas, paskirtq va- 
landu isdirbimas ir 1. 1. Tai dalykai, kuriuos destytojas pri- 
valo atlikti, bet, nesant plataus visuotinio pritarimo uni- 
versitete, daugeliu atvejq visa tai net nera pareigos. Dau- 
guma isvardytq darbq reikalauja paklusnumo ir grupinio 
darbo, bet tai ne koreliatyvios gero destymo sqvokos, ir, 
zinoma, tai ne pareigos. Dar kartq pabreziame, kad aka- 
deminis personalas turi buti jvairus. Per didelis paklus- 
numas nera geras dalykas, taciau koks administratorius 
jums galetu pasakyti, kad paklusnumo kada nors yra bu- 
vq per daug. 

Oficialus siu pareigybiq sqraso patvirtinimas gali tu- 
reti nepageidautinq pasekmiq. 15 Jei pareigybiq s^rasas 
tampa kontrakto dalimi ar reglamentu, jis gali tapti kliuti- 
mi kurti naujas kurybingas destymo formas. Tai gali ska- 
tinti administracijq ir komitetus daugiau demesio skirti dar- 
bq jvardijimui nei destymui, kurj siekiama jvertinti. Cia ob- 
jektyvumo paieskos pasekmes gali buti ne vien tik paties 
konstrukto nepagrjstumas, bet ir logikos nepagrjstumas 16 
(Messick, 1989). 


3.3. DUTIES OF INSTRUCTORS 
Many college administrators promote the use of stu- 
dent ratings of instruction obtained from checklists or 
questionnaires describing teacher behaviors, out- 
comes and/or duties. Rating systems have been de- 
veloped to an art 12 , and need to be part of any com- 
prehensive evaluation of campus teaching. But as 
widely used, the responses should not be treated as a 
representative sample of student population, even for 
a single classroom. They are an important communi- 
cation from the students who respond. One should 
expect to learn as much from so-called deviant re- 
spondents as from the modal. Standardized checklists 
and questionnaires can be useful but it should be no- 
ticed that few of them are concentrated on duties, partly 
because students have little opportunity for observing 
the performance of most of the duties. 

What instructors are obligated to do, in and out of 
class, needs to be at the center of the evaluation 
(Scriven, 1974; Borich, 1977). But what they are ob- 
ligated to do is more a matter of custom that a contr- 
actual specification. When failing to win tenure or pro- 
motion, the instructor usually is charged with insen- 
sitivity, ethical violation, or failing to complete work, 
but not with violation of an explicit duty. Yet, it is just 
such sense of duty, as beheld by administrators, col- 
leagues, and students, as well as self, that should be 
the primary basis for formally evaluating quality of in- 
struction. Yet it is easy to find lists of duties to assess 
an instructor’s performance. For faculty evaluation, Mi- 
chael Scriven (1988a, 1988b) developed an approach 
called Duties-Based Teacher Evaluation (DBTE) 13 . 
He identified the duties of the instructor as shown in 
Figure 3. 

An important distinction should be made between 
what can be considered generic duty and being a good 
department member. Both are grounds for evaluation and 
both are negotiable, but one is an contractual and the 
other is ritual, some form of experiential agreement with 
administrators and with fellow instructors. When discus- 
sing responsibilities and advancement with an instruc- 
tor, it is not uncommon for administrators to identify needs 
and expectations, such as attending faculty meetings, 
turning in business forms on time, avoiding grade infla- 
tion, fulfilling office hours, and so on. Such are the things 
that instructors should do but, without broad and explicit 
endorsement across the campus, most are not duties. 
Many are pressures for compliance and teamwork, not 
even correlates of good teaching and certainly not du- 
ties. We will mention again the need for diversity within 
any faculty. Too much compliance is a bad thing - al- 
though what administrator would ever testify having had 
too much of that. 

Institutionalizing a list of those duties can lead to un- 
desirable consequences. 15 If a duties list becomes part 
of contract or regulation, it can become a barrier to de- 
velopment of new and creative forms of instruction. It can 
lead administrators and committees to put more empha- 
sis on the rubric than on the instruction being evaluated. 
Here too, the search for objectivity may lead not only to 
construct invalidity but to consequential invalidity 16 as well 
(Messick, 1989). 
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3 pav. Destytojo profesines pareigos 14 (Saltinis: M. Scriven, 1994, p. 25-32. Panaudota gavus leidimq) 
Figure 3. The professional duties of an instructor 14 (Adapted from Scriven, 1994, pp. 25-32. Used by permission) 


1 . Zinios apie pareigas Zinios apie aukstojoje mokykioje ar institucijoje taikomus jstatymus ir nurodymus bei 

atitinkamos mokyklos lukescius. Zinios apie reikalavimus, keliamus destytojo pareigoms ir 
studijy programai. Supratimas, kad svarbu vykdyti jsakymus ir nurodymus ir kad nera 
pasiteisinimo del neprofesionaiiai atlikto darbo ar etikos normy pazeidimy. 

1 . Knowledge of duties Includes knowledge of the law and regulations applying to their college or institution as 

well as the expectations at a particular school. It includes understanding of the curriculum 
requirements and duties, includes understanding that the obligation to follow orders and 
regulations must be given significant weight; but that it never constitutes an excuse for 
seriously unprofessional or ethical standards. 

2. Zinios apie universitetq ir akademing bendruomenq Bet kuriy universiteto, personalo, studenty ir universiteto (mokyklos) aplinkos specially 

ypatumy, pagrindiniy dalyky ir ideologijos suvokimas. 

2. Knowledge of school and community Includes an understanding of any special characteristics, background, or ideology of the 

school, its staff and students, and of its environment. 

Zinios apie (a) dalyko srities (sriciy) kompetentingumq; 

(b) bendruosius studijy turinio dalykus, pvz., angly kalbq, studijavimo igudzius, 
asmeninj ir profesinj sqmoningumq, kompiuterines studijas irt. t. 

Includes knowledge (a) in the field (s) of special competence; 

(b) In across the curriculum subjects like English, study skills, personal/vocational 
awareness, computer studies, etc. 

(a) kurso planavimas, (b) medziagos atranka ir jos kurimas, 

(c) kompetentingas gaunamy saltiniy naudojimas, (d) kurso ir studijy programos 
jvertinimas, (e) zinios ir procedOros, kokiais budais patenkinti specifiniy grupiy poreikius, 
(f) zmogiskyjy resursy naudojimas (pvz., studijy turinio specialisty, audio ir video jrasy, 
metodikos specialisty), kai reikia. 

Includes (a) Course design, (b) selection and creation of materials, (c) competent use of 
available resources, (d) Course and curriculum evaluation, (e) knowledge and procedures 
for addressing the needs of special groups, (f) use of human resources (e g., curriculum 
specialists, audio-visual and methods specialists) when appropriate. 

(a) testavimo gebejimai, (b) zinios apie vertinimq (pazymiy rasymq, rezultaty suvedimq, 
rangy sudarymq ir diagnozavimq), (c) vertinimo procedury jgyvendinimas, (d) pazymiy 
paskirstymas (rangy sudarymas). 

Includes (a) Testing skills, (b) grading knowledge (marking, scoring, rating, diagnosing), 
(c) establishing grading procedures, (d) grade allocation. 

(a) kiekvienam studentui, (b) apie kiekvienq testy, (c) administracijai, (d) tevams, 
globejams ir kitoms atitinkamoms instancijoms. 

Includes (a) To each student, (b) on each test, (c) to the administration, (d) to parents, 
guardians and other appropriate authorities 

(a) bendravimo jgudziai, (b) vadybiniai jgudziai atsizvelgiant j standartq (pvz., 
disciplina, pasiekimai, isreiskiantys projektuojamq turinj atitinkamu studenty supratimo 
lygmeniu), eigesys kritinemis situacijomis (pvz., gaisro, potvyniy, taifuny , zemes 
drebejimy, vulkany issiverzimy , pOgos atvejais irt. t.). 

Includes (a) Communication skills, (b) management skills under standard (e.g., discipline, 
achievement covering the designed content with the appropriate level of student under 
standing), and emergency conditions (e.g., fire, flood, tornado/typhoon, earthquake, 
volcanic eruption; blizzard, etc). 

(a) profesionalus poziuris ir dalyvavimas profesiniame tobulejime (pvz., nuolatinis studijy 
medziagos ir plany atnaujinimas, savqs jvertinimo irtobulejimo proceduros). 

Includes (a) professional attitude and engagement on professional development (e.g., 
engaging in systematic improvement of class materials and plans, procedures for self- 
evaluation and development when appropriate) 

9. Profesines paslaugos (a) zinios profesiniais klausimais, (b) profesines etikos zinios ir jy laikymasis, (c) pagalba 

pradedantiesiems ir kolegoms, (d) darbas projektuose su kitais profesionalais, (e) indelis j 
tyrimy sritj, is kudos semiasi profesiniy gebejimy ir patirties. 

9. Service to the profession Includes (a) Knowledge about professional issues, (b) knowledge and performance in 

accordance to professional ethics, (c) helping beginners and peers, (d) work on projects 
for other professionals, (e) contributions to the research from which the profession draws 
its skills and expertise. 


7. Auditormio darbo gebejimai 

7. Classroom Skills 

8. Asmenines savybes 

8. Personal characteristics 


5. Informacijos apie studenty mokymqsi rinkimas 

5. Gathering information about student learning 

6. Informacijos apie studenty mokymqsi teikimas 
6. Providing Information about student learning 


3. Studijy dalyko zinios 
3. Knowledge of subject-matter 


4. Destymo projektavimas 


4. instructional Design 


104 


AUKSTOJO MOKSLO KOKYBE • THE QUALITY OF HIGHER EDUCATION • 2004/1 


Siulydamas DBTE (Pareigybinis destytojo jvertinimas) 
Michael Scriven primygtinai ragina aukstosios mokyklos 
administracijq sudaryti issamq akademinio personalo pa- 
reigu sqrasq, jas sunumeruoti ir palyginti. Visq pirma rei- 
kia sumazinti saliskumq. Kai pareigos aiskiai apibreztos 
ir del ju sutarta, sumazeja pavojus, kad jvertintojo salisku- 
mas lems rezultatus. Saliskumq reikia kontroliuoti. Taciau 
daznai neimanoma atskirti saliskumo nuo tikro suprati- 
mo. Koncentravimasis j aiskq ir tikslq zodinj apibrezimq 
sumazina demesj svarbiems sudetingiems santykiams. 
Pati nuopelno prasme gali buti neteisingai jvardyta. Ve- 
liau kitame poskyryje mes labiau akcentuosime tai, kaip 
priimti sudetingus sprendimus apie destymq kaip verty- 
bp ir maziau demesio skirsime nuopelnu numeravimui. 

3.4. PATIRTIMI GRINDZIAMI SPRENDIMAI 
Destytojo jvertinime pagal jo pareigybp iskeliamas vie- 
nas esminis veiksnys aukstosios mokyklos jvertinime - 
gero destymo apibrezirmas. Scriven apibudina jj taip: „Visa 
tai, kas gerai vertinama pareigybiq sqrase” (1 999, p. 33). 
Nors sioje metodikoje nukrypstama nuo studento rezul- 
tatais pagrjsto destytojo jvertinimo ir akcentuojama tai, 
kq destytojas privalo daryti, taciau joje taip pat negalima 
atmesti rezultatq rodikliq, destytojo savybiu ir destymo 
bGdq trukumu. Sios metodikos taikymas tiesiogiai dar ne- 
garantuoja gero destymo skatinimo ir neatspindi politi- 
nes destymo tikroves. 

Jei mqstysime placiau ir giliau, didaktiskai ir politiskai, 
geriau suprasime destytojo darbq, nepasitikesime vien 
tik kriterijais pagristais jvertinimais, atliktais remiantis des- 
tytojo darbo apibendrinimais. Is dalies mGsu mqstymas 
apie gerq destymo kokybg turi buti paremtas holistiniu 
atskirq destymo momentu vertinimu. Reikia ne tik intuici- 
jos, bet ir protavimo, kad jvertintume nuopelnus. Taikant 
sj dvejopq poziGrj, destymo nuopelnai buna situaciniai ir 
galimi pakartoti daugybg kartu perspektyvoje. Bet kuris 
destymo pareigos atlikimas konkreciu atveju gali buti ge- 
ras ir attitikti kai kuriuos studento poreikius, taciau dar 
geresnis ar dar blogesnis buti kitais kartais (pastebekite 
panasumqsu kriteriniu ir interpretaciniu programos jver- 
tinimu, minimu R. Stake, 2004). 

DBTE (Pareigybinis destytojo jvertinimas) geras des- 
tymas apibreziamas visq pirma remiantis tuo, kaip jis ati- 
tinka detaliai isdestytq destytojo pareigybp. Mes vertina- 
me tokj apibrezimq, taciau tikime, kad destytojo darbas 
yra sudetingas procesas, iseinantis uz „pareigos” atlikimo 
ribLj, be politiskai detalaus isvardijimo tokiam apibrezimui 
trGksta prasmes, jis priestarauja bet kokioms ilgalaikems 
vertybems. Destymo efektyvumas yra situacinis, jis gali 
keistis siekiant jvairiq tikslq, dirbant su skirtingais studen- 
tais ir turiniu, skirtingu laiku. Pareigq kaip kriteriju s^rasas 
turi privalumu jvertinant destym^ - atsakomybe paprastai 
nera pervertinama, vertinama santuriai, o j jrodymus to- 
kiais atvejais dazniausiai neatsizvelgiama (Scriven, p. 36). 
DBTE turetq buti remiamasi kaip naudingu ir praktiniu ver- 
tinimo komponentu, kuriame daznai per mazai atsizvel- 
giama j destymo ir mokymosi situacijos sudetingumq. To- 
del jvertintojas, kad ir kas jis butq - administratorius, kon- 
sultantas ar komitetas - privalo jungti siuos kriterijais grjs- 
tus vertinimus su holistiniu poziuriu j destymo kokybp. 

j siq Scriven metodik^ verta atkreipti demesj, nes ji 
skirta „susilpninti kritinio pobGdzio jvertinimo elementams 


With DBTE, Michael Scriven urges campus admini- 
strators to be explicit about the duties of faculty mem- 
bers. He urges treating them numerically and compara- 
tively. His primary urging is to reduce bias. When du- 
ties are clearly expressed and agreed upon, the chances 
are lower that evaluator bias will determine the out- 
comes. Bias does need control. But often it is not possi- 
ble to distinguish between bias and deep understan- 
ding. Concentrating on clear and precise wording di- 
minishes attention to important complex relationships. 
It may change the meaning of merit. In the following 
section, we urge more emphasis on reaching complex 
judgments of teaching value, less emphasis on repre- 
senting merit numerically. 

3.4. EXPERIENTIAL JUDGMENT 
Duties-based teacher evaluation underlines one key is- 
sue in the evaluation of college teaching, the definition 
of good teaching. Scriven defined it “whatever scores 
well on the duties list” (1999, p. 33). Although this ap- 
proach successfully moves away from student-out- 
comes-based teacher evaluation and focuses on what 
instructors must do, its limitations are similar to those 
for outcome indicators, teacher traits, and teaching sty- 
les. It does not directly engage the facilitation of good 
learning and it does not acknowledge the political reali- 
ties of instruction. 

If we understand broadly and deeply, pedagogically 
and politically, what instructors do, we will avoid relying 
alone on criterion-based evaluations built from general- 
izing about performance. Part of our thinking of teaching 
quality needs to draw upon holistic appreciation of indi- 
vidual teaching moments. We need both intuition and 
reasoning to appreciate merit. Within this binocular view, 
the merit of an instructor's teaching is situational and re- 
peated in multiple perspectives. Any one performance of 
teaching duty may be good for some student needs some 
of the time, and better or poorer at other times (notice 
the similarity to criterial and interpretive program evalua- 
tion in Stake, 2004). 

In DBTE, good teaching is defined primarily in terms 
of instructor performance in meeting the duties expli- 
cated. We appreciate this contribution, yet believe that 
an instructor’s teaching is complex beyond “duties” rep- 
resentation, lacking meaning without political specifica- 
tion, and resisting any durable simplex of values. Good- 
ness of teaching is situational, it can be different for dif- 
ferent purposes and different students and contexts, and 
times. Having a list of duties as criteria for evaluating 
teaching has the advantage of bringing in responsibility 
typically underplayed and evidence typically ignored 
(Scriven, p. 36). DBTE should be perceived as a useful 
and practical component, but one that seldom attends 
enough to the situational complexities of teaching and 
learning. Merging those criterial values with a delibe- 
rated holistic view of teaching quality is the responsibi- 
lity of the evaluator, whether administrator, mentor or 
committee. 

This approach of Scriven’s is of special interest be- 
cause it works “to reduce the judgmental elements of the 
evaluation by introducing . . . objective criteria” (p. 121). 
He finds judgment to be problematic and claims that 
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pateikiant ... objektyvius kriterijus” (p. 121). Jo nuomo- 
ne, kritinio pobudzio jvertinimas problematiskas, bet su- 
mazinus tendencingumq ar vertinimo paklaidq, vertinimai 
dazniausiai pagereja. Scriven pripazjsta, kad jokie zmo- 
gaus svarstymai negali buti visiskai nesaliski, bet jvertini- 
mas geras tuomet, kai sprendimo saliskumas minima- 
lus. 

3.5. SALISKUMAS 

Saliskumq, anot Michael Scriven, galima sumazinti issa- 
miai apibudinant pareigas ir taikant matematinius ap- 
skaiciavimus. Taip galime pasiekti galutinq netendencin- 
go kritinio pobudzio sprendimo vertinime sintezq. Taciau 
kritinio pobudzio sprendimas ir saliskumas yra neatsie- 
jamos gero jvertinimo pastangq dalys. Saliskumq gali sq- 
lygoti ne tik bet kuris informacijos saltinis, bet ir jvertini- 
mo sumanymas bei jo organizavimas. Net jei turetume 
patj issamiausiq pareigq sqrasq (kuriam pritartq visi des- 
tytojai), vis tik negaletume isvengti jvertintojo saliskumo. 

Saliskumas nera tik netikslumas. Kai kuriais atzvilgiais 
saliskumas pasireiskia kaip kulturine diskriminacija. Nu- 
sistatymas pries kai kuriuos destymo stilius ar kulturine 
orientacija jau laikoma diskriminacija, potencialiai jzei- 
dziancia destytojq ir jo ar jos studentus. Saliskumas yra 
rimta musq aukstosios mokyklos problema. Realu tiesio- 
ginj zalingo saliskumo pavojq negalima kildinti vien tik is 
etikos kodeksq, nurodymu pazeidimq, jo negalima is- 
vengti vien tik tiksliai apibrezus pareigas. Naudinga rem- 
tis direktyviniais dokumentais, taciau realiq situacijq su- 
detingumas taip pat reikalauja ir zmogisko suvokimo, dia- 
logo, interpretacijos irasmeniniq sprendimq. 

Beveik pussimtj metq atliekami tyrimai destymo jver- 
tinimo srityje buvo saliski ir juose labiau linkstama su- 
paprastinti situacijq, efektyvinti vadybq ir palengvinti ko- 
munikacijq. 17 Daugybe tyrimu buvo atlikta siekiant supa- 
prastinti vertinimq iki formaliq taisykliu apibudinimo (Ber- 
lak ir kt.,1992; Farland ir Gullickson, 1996; Mabry, 1999). 
Atrodytq, tarsi siq tyrimu autoriai skatintq atsisakyti jverti- 
nimo pagrjstumo garbindami objektyvumq. Kreipdami 
svarbiausiq demesj j tikslias ir standartizuotas formuluo- 
tes, tikriausiai per maza demesio skirsime tarn, kaip des- 
tytojas elgiasi kritiniais momentas ir politinese situacijo- 
se. Kulturiniq aspektq prisodrintos interpretacijos yra 
saliskos, bet jos esmines, padedanccios suprasti issila- 
vinimo vertg. jvertinimas be tokiu interpretacijq bus su- 
paprastintas. Pats saliskumas neatspindi problemos, kaip 
turi buti atliktas pagrjstas destymo kokybes jvertinimas, 
esmes. 

Mes, jusq autoriai, nesmagiai jauciames taikydami 
paprastas skales ir priezastiniq rysiq sqvokas 18 . Reitin- 
gai, rodikliai, charakteristikos ar pareigybiu sqrasai ne- 
turetq nustelbti intuicijos ir sqmoningq samprotavimq. 
Destymo jvertinimui reikalingos asmenines interpreta- 
cijos ir sprendimai ne tarn, kad butu taikomi vietoj krite- 
rijq, kategorijq ir rodikliu, bet butent po to, kai sie krite- 
rijai ir rodikliai jau panaudoti. Sprendimo priemimas yra 
auksciausias jvertinimo taskas. Neturetume deti tiek pa- 
stangq stengdamiesi istobulinti vertinimo kriterijus, o rei- 
ketu labiau stengtis patobulinti sprendimo pateikimq. Visi 
dirbantys jvertintojai turetq siekti suprasti specifing des- 
tymo situacijq ir nagrineti jq visapusiskai jvairiais poziu- 
riais, reiksdami abejones ir perziuredami is naujo. Su- 


evaluations generally improve with the reduction of bias. 
He acknowledges that no human contemplation can be 
completely bias-free, but that good evaluation is that that 
holds judgment to a minimum. 

3.5. BIAS 

Michael Scriven has urged diminishing bias by explicit 
definition of duties and using mathematical weighting to 
arrive at a final low-judgment synthesis of value. But judg- 
ment and bias are undifferentiated parts of any good 
evaluation effort. There is bias not only from each of the 
main information sources but also bias in the design and 
conduct of the evaluation. Even if we had the most com- 
prehensive list of duties (a list that instructors might agree 
upon), evaluator bias still will operate. 

Bias is not just imprecision. Some bias is cultural dis- 
crimination. Bias against a certain teaching style or cul- 
tural orientation is discrimination, potentially hurtful to the 
instructor and to his or her students. It remains a serious 
problem in our departments. The real and immediate 
danger of hurtful bias cannot be sufficiently derived from 
codes of ethics, from regulations, from standards, nor 
avoided by precise definitions of duties. It helps to have 
reference documents, but the complexity of real situa- 
tions also requires human perception, dialogue, interpre- 
tation, and personal judgment. 

Almost a half century of research on faculty evalua- 
tion has been biased towards simplicity, management 
efficiency, and ease of communication. 17 Much of the 
research has worked at reducing valuing to a formal ru- 
bric (Berlak et al.,1992; Farland & Gullickson, 1996; 
Mabry, 1999). Its promoters sound as if we should forego 
the validity of the evaluation in our honoring of objectiv- 
ity. By putting primary attention on precise and stand- 
ardized wording, we can expect to diminish attention 
on how the instructor has performed in critical moments 
and in political circumstances. Culturally rich interpre- 
tations are biased - and they are essential to the under- 
standing of the value of education. Evaluation without 
such interpretation is simplistic. Bias itself is not the 
essence of the problem of obtaining valid evaluation of 
teaching quality. 

We, your authors, feel uncomfortable with simple 
scales and notions of causal links 18 . Intuition and cons- 
cious reasoning should not be over-run by ratings, in- 
dicators, characteristics, or lists of duties. Evaluation 
of teaching requires personal interpretation and judg- 
ment - not necessarily in place of criteria, categories 
and indicators, but, especially, after using them. Judg- 
ment should be at the pinnacle of the evaluation. Rather 
than putting so much effort into refining criteria, we think 
that more effort should be put into improving judgment. 
All practicing evaluators should seek understanding 
about the particular teaching by studying it from diffe- 
rent points of view and frames of reference, by submit- 
ting it to challenge and review. The complex picture of 
quality should not be morphed into a simple indicator. 
Rather, context-relevant discussion of multiple meanings 
of quality is preserved. Through dialectic critique we can 
improve intuition, quality recognition and judgment 
(Stake et al., 1997). 
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detingas kokybes vaizdas neturetq buti staigiai pavercia- 
mas paprastu rodikliu. Vertetu palaikyti turiniu pagrjstq 
diskusijq apie jvairiausias kokybes prasmes. Pritaikius 
dialekting kritikq galime tobulinti intuicijq, atpazinimo ko- 
kybp ir sprendimq priemimq (Stake ir kt., 1997). 

4 

ATSKAITOMYBE 

jvertinant destymq sprendziamas ir politines atskaitomy- 
bes klausimas. Destytojas tampa atsakingas daugybei 
zmoniq: studentams, savo kolegoms, administracijai, pi- 
lieciams ir sau paciam sudarydamas tiesioginius, aiskiai 
apibreztus ar netiesioginius, numanomus susitarimus. 
Destytojai atsakingi uz tai, kqjie veikia, ir uztai, kqjie kitu 
zmoniq supratimu veikia. 

Viesai susitardami ir pasirasydami kontraktq, rasyda- 
mi ar kreipdami demesj j kurso medziagq, netiesiogiai 
skirdami darbq projektus ar egzaminuodami destytojai 
atsako uz daugelio savo pareigq atlikimq. Vien savo aka- 
deminiu elgesiu, neistargs ar neparasgs ne zodzio des- 
tytojas prisiima didelg atsakomybg. Naudodamasis va- 
doveliu (nebent jis tq vadovelj neigtLj) destytojas imasi 
padeti studijuoti dalykq remdamasis to vadovelio kon- 
cepcija. Uzjausdamas kg nors ar apramindamas, sutin- 
ka kreipti demesj j kito zmogaus poreikius. Kai destyto- 
jas buna palyginti nenuoseklus, tai elgiasi neatsakingai 
tu zmoniq, kurie is jo tikisi jprastinio elgesio, atzvilgiu. 

Visij pirma, atskaitomybe - tai dary mas to, kg esipazade- 
jps -tiesiogiai ar netiesiogiai - atiikti. Kai kurie pazadai svar- 
bus visai aukstajai mokyklai. Visa universiteto katedra atsa- 
kinga ne vien tik uz studentq mokymqsi, bet taip pat ir uz 
personalo saugumg pastate, supazindinimq su skirtingo- 
mis etninemis vertybemis, jvairiq profesiniu vaidmenu mo- 
deliu pristatymq studentams; lygiq studiju galimybiq suda- 
rymg. Kiekvienas destytojas prisiima dali sios atsakomybes. 

Savo atsakomybes pripazinimasyca antrasis atskaito- 
mybes aspektas. Destytojo atsakomybe issamiai aptarta 
programose, kursu aprasuose ir studijq dalyko progra- 
mose, bet kiekvienas destytojas prisiimdamas jg, istobu- 
lina dar labiau. Destytojai elgiasi neatsakingai, jei jiems 
nepavyksta padeti zmonems jgyvendinti aukstosios mo- 
kyklos atskaitomybes. Vienu metu JAV prezidentas Har- 
ry Truman ant savo rasomojo stalo buvo uzsirasgs toki 
sukj: „Atsakomybe tenka jums” („Toliau jau atsakomy- 
bes nastos negalima niekam perkelti”, - vert. past.). At- 
sakomybg jauciantis destytojas prisiima tg nastg, teikia 
pagalbg studentams (nors sulaukia ju atsikalbinejimq), 
padeda katedros personalui vykdyti jsipareigojimus. To- 
del destytojui privalu leisti zmonems zinoti, kg jis veikia. 

Taigi priartejome prie treciojo destymo atskaitomybes 
aspekto: veiksmo atskieidimo. Sis atskleidimas yra svar- 
besnis nei ketinimLj nustatymas. Destytojo prievole pa- 
deti profesionalams, studentams ar visuomenei matyti, 
kg jis veikia. Vadinasi, atskaitomybe yra ne tik duotq pa- 
zadq tesejimas ir asmenines atsakomybes identifikavi- 
mas, bet ir atliekamij veiksmij atskleidimas. Nors didzioji 
destytojo-studento bendravimo dalis turetq vykti privacio- 
je aplinkoje, gerbiant abiejq teises, etiketo pazeidimq ne- 
reiketq ginti. Didzioji dalis to, kas is esmes apskritai vyksta 
neturetq buti asmeninis dalykas. 


4 

ACCOUNTABILITY 

Evaluation of teaching needs to address the issue of po- 
litical accountability. An instructor is accountable to many 
people: to students, to fellow instructors, to administra- 
tors, to citizens, to herself or himself. Instructors make 
agreements, explicit or implicit, with these people. Instruc- 
tors are accountable for what they do and for what those 
other people understand they are doing. 

The instructor is responsible for many duties, having 
agreed explicitly by signing a contract and by writing or 
heeding a course description, and more indirectly by 
assigning projects and by authoring examinations. 
Through pedagogical behavior, without words spoken or 
written, he or she assumes many responsibilities. By 
using a textbook (unless disaffirming it) she or he agrees 
to teach its subject matter. By giving sympathy and con- 
solation, he or she agrees to attend to the needs of aspi- 
rants to career lines. When an instructor is markedly in- 
consistent, he or she is not being accountable to those 
who have developed expectations through customary 
behavior. 

Accountability, first of all, is a matter of doing what 
has - in one language or another - been promised. Some 
promises are campus-wide promises. The whole depart- 
ment is to be accountable, not only accountable for stu- 
dent learning but for much more: personal safety in the 
building; introduction to different ethnic values; opportu- 
nity to relate to different professional role models; egali- 
tarian distribution of learning opportunities. And each in- 
structor shares in the responsibility. 

A second aspect of accountability is the acknowl- 
edgement of one’s responsibility. Programs, course de- 
scriptions and syllabi spell out teaching responsibilities, 
but each instructor refines the acknowledgement. In- 
structors are not being accountable if they fail to help 
people realize the nature of the college’s responsibility. 
One time U. S. President Harry Truman displayed a motto 
on his desk: “The buck stops here.” The accountable in- 
structor is one who accepts the responsibility buck, one 
who lends support to students getting the runaround, and 
one who helps the department staff allocate and dis- 
charge their responsibility. Instructors have an obligation 
to let people know what they are doing. 

This brings up a third feature of teaching account- 
ability: disclosure of action. This disclosure goes beyond 
identification of intention. The instructor has an obliga- 
tion to facilitate review - whether professional, student or 
public review - of what he or she is doing. Accountabili- 
ty, besides being a fulfillment of one’s promises, besides 
being the identification of personal responsibility, is a 
matter of disclosure of action taken. Even though much 
teacher-student interaction should occur in an atmos- 
phere of privacy, with provision both for the rights of stu- 
dent and teacher, improprieties should not be protected. 
The larger picture of what in essence and in general is 
happening is not a private matter. 

Such three dimensional definition of instructional ac- 
countability does not require that a instructor determine 
and disclose the impacts of his or her teaching. Unless 
explicitly or implicitly agreed to, instructors are not re- 
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Toks triju lygmenq destymo atskaitomybes apibre- 
zimas nereikalauja, kad destytojas nusprgstq ir atvertq 
daromq savo destymo poveikj. Destytojai nera atsakingi 
uz informacijos apie studento darbq atlikimq pateikimq, 
nebent del to buvo tiesiogiai ar netiesiogiai susitarta. Jver- 
tinti darbai, pokalbiai su tevais ir studentu egzaminu duo- 
menys yra informacines sistemos dalis, taciau tai labai 
silpni destymo efektyvumo rodikliai. Daugelyje aukstqjq 
mokyklij is destytojq nera reikalaujama pateikti studentq 
jvertinimus kam nors kitam, o tik patiems studentams. 
Didesne destymo dalis siandien gali buti laikoma atsi- 
skaitymo priemone, nors administracijai ir nera pateikia- 
mi kriteriniai duomenys. Atsizvelgiant j ribotq studentq 
kontroliniu darbq atlikimo ir destymo kokybes rysj (R. Sta- 
ke, 1995), toks nereiklumas yra pateisinamas. Taciau ka- 
dangi oficialiai nustatyta, kad egzaminai aukstojoje mo- 
kykloje yra atsiskaitomumo komponentas, destytojai turi 
paklusti Siam reikalavimui. Daugeliu atveju destytojai dir- 
ba kartu su katedros vadovais ir is tiesq stengiasi apibu- 
dinti, kaip sekasi jq studentams, kaip kinta jq supratimas, 
ar pazangesni studentai gerai rengiasi savo busimai kar- 
jerai, ar ne. 

Butq per daug paprasta manyti, kad atskaitomybe re- 
alizuota, jei kontroliniq darbq rezultatai priimtini. Atskai- 
tomybe yra susitarimq vykdymas. Kai kuriais atvejais sie- 
kiama, kad testq rezultatai butq aukstesni nei bendras 
lygis, bet daugeliu atveju tokio reikalavimo nera. Desty- 
tojas atsakingiausias salia esantiems zmonems. Tai, kaip 
destytojas bei tie zmones suvokia atsakomybg, ir sudaro 
svarbiausiq destytojo atsiskaitomybes turinj. 

4.1. DIRBANTI BENDRUOMENE 
Tradicinio destymo aukstojoje mokykloje jvertinimo sam- 
pratos centre - atskiro, dazniausiai auditorijoje autono- 
miskai dirbancio destytojo jvertinimas. Siuo atveju des- 
tymas ir jo jvertinimas traktuojamas kaip vykstantis audi- 
torijoje ir toks jvertinimas siekia nustatyti atskiro destyto- 
jo atsakomybg. 19 

Siame poskyryje aptarsime konkurencijos sampratq. 
Jos demesio centre yra kiekvieno destytojo indelio palai- 
kant ir tobulinant visas studijq programas aukstojoje mo- 
kykloje jvertinimas. Tai, kq destytojai veikia tiesiogiai dirb- 
dami su studentais auditorijoje, zinoma, yra svarbu, ta- 
ciau taip pat svarbu nustatyti, kaip destytojai prisideda 
prie visos katedros teikiamq paslaugq integralumo. Cha- 
rizmatinis lektorius ar naujoviskai dirbantis laboratoriniq 
darbq organizatorius ar asmeninis konsultantas neturetq 
gauti auksciausiq jvertinimq, jei jq visq indelis per men- 
kas, siekiant silpnq, neteisinga linkme nukreiptq, pavirsuti- 
niskq ir pasenusiq destomq kursu katedroje pagerinimo. 
Norint, kad aukstosios mokyklos darbas butq tinkamai 
jvertintas, turi buti atsizvelgta ne tik j individualq, bet ir j 
grupinj indelj (Porter, 1989). 

Jei daugelyje katedru akademinio personalo nariq 
bendradarbiavimas svarstant destymo problemas ir vyks- 
ta, tai labai minimaliai. Destytojq personalo kaip „profe- 
sines bendruomenes” 20 idejq pasiule Philip Morrison ir 
John Seely Brown 21 bei jq kolegos Mokymosi tyrimq ins- 
titute Menlo Park, Kalifornijoje. Skirtingi autoriai (Wenger, 
1991, 1997; Brown, 1997;Alpert, 1998) pabrezia, kad des- 
tytojai palyginti nedaznai dirba kartu tobulindami desty- 
mo programas 22 Wenger teige: „Netgi tie, kurie kalba apie 


sponsible for presenting information about student per- 
formance. Graded papers, conferences with parents, and 
student examination data are part of the information sys- 
tem but are weak indicators of teaching effectiveness. 
On most campuses, instructors are not obligated to sub- 
mit student performance data to anyone but students. 
Most teaching today can be considered accountable with- 
out presenting criterial evidence to administrators. Given 
only a limited relationship between student test perfor- 
mance and teaching quality (Stake, 1995), that omission 
is defensible. Nevertheless, when departmental exami- 
nations have officially been defined as a component of 
accountability, instructors have the obligation to comply. 
In most cases, most instructors work hand in hand with 
their department officers and are, in fact, making an ef- 
fort to describe how well their students are doing, how 
much they are increasing their understandings, and 
whether or not the more advanced students are doing 
well in career preparation. 

It is too easy to think that accountability might be sa- 
tisfied by having acceptable test scores. Accountability 
is a matter of fulfilling agreements. In some places, that 
includes keeping test scores above a certain level but, in 
most places, it does not. An instructor is most account- 
able to people close at hand. What those people and the 
instructor perceive the teaching responsibility to be is the 
primary content of teacher accountability. 

4.1. COMMUNITY OF PRACTICE 
The traditional concept of evaluating college teaching 
focuses upon the evaluation of the individual, more or 
less autonomous instructors in their classrooms. This 
approach sees the teaching and its evaluation primarily 
as taking place in the classroom and targeting a single 
instructor’s responsibility. 19 

Here we want to raise a competing concept XhaX fo- 
cuses on evaluating the contribution each instructor 
makes to the maintenance and improvement of all instruc- 
tional programs in the department. What instructors do 
directly for students in their classes is, of course, impor- 
tant but what instructors contribute to the integrity of all 
department offerings is important too. A charismatic lec- 
turer or innovative lab-organizer or personalistic mentor 
should not get top marks if contributing little to upgrad- 
ing the weak, misdirected, frivolous or out-dated courses 
in the department. Both individual and team contributions 
need to be considered if campus teaching is to be ade- 
quately evaluated (Porter, 1989). 

In most departments, faculty collaboration about mat- 
ters of teaching happens, but remains minimal. The idea 
of a faculty as a “community of practice” 20 has become 
identified with Philip Morrison and John Seely Brown 21 
and colleagues at the Institute for Research on Learning 
at Menlo Park, California. Various writers (Wenger, 1991, 
1997; Brown, 1997; Alpert, 1998) have noted the infre- 
quency of instructors working closely together to main- 
tain and improve teaching programs. 22 Wenger said: 
“Even those who speak about learning organizations, life 
long learning, or the information society do so mostly in 
terms of individual learners and information processes. 
The notion of communities of practice helps us break this 
mold” (p. 7). 
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besimokancias organizacijas, mokymqsi visq gyvenimq 
ar informacinq visuomenq, tai suvokia tik atskirq studi- 
juojanciqjq ir informaciniq procesq poziuriu. Profesiniq 
bendruomeniu sqvoka padeda radikaliai pakeisti sj nusi- 
stovejusj sablonq” (p. 7). 

Daugelyje universitetq katedrq egzistuoja tokia stan- 
dartine praktika: profesoriai siulo pazangius kursus, ku- 
rie atspindi jq mokslinius pasiekimus, o doktoranturos 
programu studentai ir destytojai, kurie visq pirma siekia 
tapti profesoriais atskirose tyrimq srityse, desto kitus kur- 
sus, butinus, kad studentai galetq patekti j profesoriu 
destomus kursus. Taigi katedrq personal^ sudaro 
zvaigzdes ir zvaigzdutes, ekspertai ir naujoviq salinin- 
kai, profesoriai, kurie ne per daugiausiai rupinasi tuo, 
kq katedra siulo apskritai ir net retai tarpusavy disku- 
tuoja studijq temomis. Tai nera akademine profesine 
bendruomene. 

Daniel Alpert (1998) 23 pareiske susirupinimq del to, 
kad katedrq energija JAV iseikvojamatam, kad Naciona- 
linio mokslo fondo ir filantropiniq grupiq parama tyrejams 
ir mokslininkams butq skiriama kiekvienam atskiram pa- 
grindiniam tyrejui beveik tiesiogiai. Ta pati problema iskyla 
ir mqstant, kad destymas yra individuali, ne katedros at- 
sakomybe. 

Nesvarbu, kaip destytojai desto - talentingai ar ap- 
gailetinai, puikiai ar vangiai, ar bendradarbiauja desty- 
dami, taciau tiek destytojai, tiek katedros turi siekti, kad 
destymas aukstojoje mokykloje butu jvertintas. Tokia jver- 
tinimo sistema, kuri atsizvelgia tik j veiklq auditorijoje, o 
nesiekia kruopsciai istirti katedros pastangq kuriant mo- 
kymosi galimybes, tera tik apgailetinos pastangos megi- 
nant jvertinti destymo kokybq. 

Wheeler Loomis, 24 kazkada garsus Fizikos katedros 
vadovas, savo kiseneje visada turedavo katedros desty- 
tojq sqrasq, ir sqrasq „tu zmoniq, kurie daugiausiai prisi- 
dejo prie katedros veiklos”. Vertindamas destytojus, jis 
gal kartais neatsizvelgdavo j akiq kontaktq, teisingq pa- 
zymiu rasymq ir zavesj klaseje, bet visada vertindavo des- 
tymq kaip kolektyvinq atsakomyb^. 

Destymui aukstojoje mokykloje budingos sios ketu- 
rios problemos: 

a) menki destytojq komunikaciniai gebejimai; 

b) reta ir silpnai organizuojama individuali pagalba 
studentams; 

c) silpnas rysys tarp gretutiniq ir veliau siulomq kursq; 

d) sudetingu kursu siekiama atrinkti kandidatus 
aukstesnio lygmens darbui, o ne ismokyti kiekvienq stu- 
dent^ pagal jo pajegumus. 

Studentams jvertinant destymq paskutines dvi proble- 
mos nebuvo atskirai minimos, nes studentai menkai zino 
apie disciplinos turinj ir raidq. O daugelis akademinio per- 
sonal nariq desto tokius specializuotus kursus, kad net 
nezino, nei kas vyksta kituose katedros kampuose, nei 
kas destoma kitu gretutiniq dalykq metu. Tarpdalykinis 
rysys ir kursq sudetingumas yra bendra viso akademinio 
personalo problema, nors daugelio destytojq darbas ver- 
tinamas gana gerai, net jei jie minetas problemas igno- 
ruoja. Visoms keturioms isvardytoms problemoms reika- 
lingas bendras viso akademinio personalo demesys. To- 
del atskiro akademinio personalo nario darbo kokybe tu- 
retq is dalies buti grindziama jo indeliu j siq problemu 
sprendimq. 


Standard practice in many departments on many cam- 
puses is for individual professors to offer advanced 
courses that reflect their own scholarly distinctions and 
for graduate students and instructors primarily interested 
in becoming research professors to teach the prerequi- 
sites. These departments are a collection of stars and 
lesser lights, expert and noviate iconoclasts, professors 
worrying not very much about department offerings as a 
whole, seldom even talking among themselves about 
educational issues. A community of teaching practice, it 
is not. 

Daniel Alpert (1998) 23 has expressed concern about 
the drain on department vigor in the U.S.A. to have the 
National Science Foundation and philanthropic groups 
finance researchers and scholars more or less directly to 
the individual principal investigator. The same problem 
appears to exist in thinking of teaching as an individual 
responsibility rather than departmental. 

Teaching brilliantly or pitifully, and collaborating well 
or poorly in instruction, both individuals and departments 
need to be targeted in evaluating campus teaching. A 
evaluative system which only looks at the ongoing col- 
lege classroom and fails to scrutinize department effort 
to provide learning opportunities is an impoverished ef- 
fort to evaluate teaching quality. 

Wheeler Loomis, 24 once head of a distinguished Phys- 
ics Department used to keep a list of faculty names in his 
pocket, a list of “those who contributed most to the de- 
partment.” His ratings of instructors might have neglected 
eye contact, fair grading and classroom charm; but it re- 
cognized teaching as a collective responsibility. 

Here are four problems common to campus instruc- 
tion: 

a. Instructors have poor communication habits. 

b. Organized assistance for individual students is 
weak and rare. 

c. Articulation between adjacent and subsequent 
courses is weak. 

d. Course difficulty is set to screen candidates for 
advanced work rather than to teach each student as much 
as possible. 

The last two of these problems are not prominent in 
students’ evaluation of instruction because students have 
little knowledge of the content and ongoing evolution of 
a discipline. And many faculty members are so specia- 
lized they do not know what is happening in other cor- 
ners of the department nor in allied disciplines. Articula- 
tion and course difficulty are problems for a faculty as a 
whole, yet many instructors can get good ratings for 
teaching even while ignoring them. All four of the prob- 
lems are problems that call for collective attention of a 
faculty. The quality of an individual faculty member to 
campus teaching should be partly based on his or her 
contributions to the remedy of such problems. 

4.2. A CASE STUDY 

Let us describe a senior professor. 25 He recognized him- 
self and his department chair recognized that he had 
been getting too many complaints about his teaching. 
Consider particularly the mobilization of faculty collea- 
gues to increase the effectiveness of their collective 
teaching. 
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4.2. ATSKIRO ATVEJO STUDIJA 
Charakterizuokime vyresnijj destytojq. 25 Jis prisipazjsta 
pats, o katedros vedejas taip pat patvirtino, kad sulauk- 
davo daugybes skundq del jo destymo. Atkreipkite ypa- 
tingq demesj j tai, kad katedros kolegos mobilizavo savo 
veiklq destymui savo kolektyve pagerinti. 

Pavadinsime sj profesoriu George Alderman. Jis yra 
vyresnysis realiniu mokslq destytojas, o studentq reitin- 
guose buvo vertinamas nuo zemiausio iki vidutinio balo. 
George deste daugiau kaip 20 metq. Neseniai jis buvo 
paskirtas destyti matematikos kursq, privalomq visiems 
katedros studentams. Studentai linkq manyti, kad priva- 
lomq kursq destymo kokybe zemesne uz pasirenkamq. 

Anksciau George deste kiekvienq semestrq vienai gru- 
pei studentq, kurie registruodavosi j tq kursq. Sj kartq ka- 
tedros vedejas paskirste studentus trims destytojams ir 
kiekvienas is jq deste dviem 45 studentq grupems du kar- 
tus per savaitg. George ir kitq destytoju darbas buvo jver- 
tintas nepatenkinamai. George kreipesi pagalbos j Des- 
tymo tobulinimo skyriq. Kiti du destytojai emesi glaudziau 
bendradarbiauti tarpusavy. 

Pasibaigus vienam semestrui tik George buvo jver- 
tintas nepatenkinamai. Jo reitingas dar labiau smuko is 
dalies del to, kad jis paklause patarimq ir reikalavo dau- 
giau grupinio studentq darbo, kurio metu visi studentai 
turejo vertinti vienas kitq pagal tai, kaip jie dalyvauja gru- 
pes darbe. Vienas is George studentq formaliai apkalti- 
no jj „kaprizingu vertinimu”. Katedros vedejas issiunte Ge- 
orge laiskq, kuriame reikalavo rasti budu pasitaisyti. 26 Po- 
kalbiq su kitais destytojais metu vedejas kalbedavo apie 
bendrq poreikj gerinti destymq katedroje ir pripazino, kad 
katedra neteike akademiniam personalui duomenq apie 
destymo kokybq tiesioginiu grjztamu rysiu. 

George kolega destytojas Edwards pasake: „Musq 
studentq reitingai nejvertina destymo efektyvumo. Siu- 
lau katedros kolegoms lankytis vienas kito uzsiemimuo- 
se. Tai ne tik pagerintu jaunesniqjq destytojq didaktinius 
jgudzius, betirgautume labiau patikimq grjztamojo rysio 
informacijq apie destymo efektyvumq. Taciau destymo 
stebejimas atima gana daug laiko. Kadangi destymas ne- 
ra taip atlyginamas ir vertinamas kaip tyrimai, tai didzioji 
dalis akademinio personalo nariq per daug nesuintere- 
suoti sj darbq atlikti kiek galima geriau”. George kated- 
ros vedejas pritare: „jvertindami destymq mes noretume 
panaudoti jvairius saltinius, pavyzdziui, universiteto ab- 
solventq ar kolegu jvertinimus, o ne tik dabartiniu stu- 
dentq jvertinimq, taciau tai nejmanoma. Taikome studen- 
tq jvertinimq, nes tai vienintele galimybe”. 

George taip pakomentavo Destymo tobulinimo sky- 
riaus specialists pagalbq: „Manau, kad jos pagalba vie- 
nintelis prasmingo grjztamojo rysio saltinis, kuris gali pa- 
gerinti mano destymq”. 

Kitais zodziais tariant, nebuvo profesines bendruome- 
nes, kuri galetq padeti George geriau destyti. George ir 
jo kolegos sutiko, kad kolegu lankymasis uzsiemimuose 
butq vertingas grjztamojo rysio prasme, bet jie pritare 
minciai, kad pagalba turetq buti individuali - kolega ko- 
legai, - o ne kolektyvine. George kolega Bill Wilson pa- 
sake: „Esu paprasgs kolegos dalyvauti mano paskaito- 
se ir taip susilaukiau grjztamojo rysio keturis kartus. Kai 
kuriais atvejais grjztamoji informacija buvo produktyvi, o 
kartais ne. Mano patirtis rodo, kad is kolegos ateinantis 


We will call the professor George Alderman. He was 
a senior professor in Practical Sciences receiving low to 
moderate student ratings. George had taught more than 
20 years. He recently was assigned to teach a mathema- 
tics-related course required of all students in the depart- 
ment. Students tend to report instruction in required cour- 
ses to be of poorer quality than that in their electives. 

Previously, George had taught one class each term 
to all who enrolled. The students had marked his instruc- 
tion low in quality. This time, the department head divided 
the students among three instructors, each of whom then 
taught two classes, 45 students each, meeting twice a 
week. After one semester, one of the instructors obtained 
high ratings for his teaching; George and the other got 
low ratings. George sought help from the Division of In- 
structional Development. His peers chose to work more 
closely together. 

A semester later, only George was rated low. His rat- 
ings actually went down, partly because he followed ad- 
vice to require more student teamwork, with each stu- 
dent grading each other’s participation. One of George’s 
students formally charged him with “capricious grading.” 
The department head sent George a letter directing him 
to find a way to improve. 26 In interviews, the head spoke 
of a general need for improvement of teaching and ac- 
knowledged that the department was not providing fa- 
culty members with direct feedback on teaching quality. 

George's colleague Professor Edwards said: “Our 
student ratings are not measuring teaching effectiveness. 

I advocate use of classroom visitations by peer faculty. 
Not only would this increase the rate at which junior pro- 
fessors improve their teaching skills, but we would have 
more reliable feedback regarding teaching effectiveness. 
However, classroom observations are quite time consu- 
ming. Since teaching is not rewarded to the extent that 
research is, many faculty members feel that it is not in 
their best interest to do this.” George’s department head 
agreed: “We would like to use various sources such as 
alumni or peers to evaluate instruction in addition to cur- 
rent students but this is not possible. We use students 
because they are accessible.” 

George commented on the help from the instructional 
specialist provided by the Division of Instructional Devel- 
opment: “I consider her the only source of meaningful 
feedback available to improve my teaching.” 

In other words, there was no community of practice 
to help George teach better. George and his colleagues 
agreed that peers could be a valuable source of feed- 
back, but they stuck to the idea that help should be per- 
son-to-person rather than collective. George’s colleague, 
Bill Wilson, said: “On at least four occasions I have asked 
a colleague to sit in my class and provide me with feed- 
back. Sometimes the feedback from a peer is produc- 
tive; sometimes it is not. My experience is that the feed- 
back from a peer is more useful when it is provided in 
private (if the department does not get the information).” 

Another colleague, Frank Edwards, said: “In this de- 
partment, formal mentoring does not exist. It is quite com- 
mon, however, to have informal mentoring, where one 
faculty member helps another.” And George said: “The 
feedback from a colleague may work if several profes- 
sors teach the same subject, they observe each other 
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grjztamasis rysys naudingesnis, kai jis yra asmeninis, o 
ne tuomet, kai profesoriai raso ataskaitas administraci- 
jai”. 

Kitas kolega, Frank Edwards, pasake: „Sioje kated- 
roje formalaus konsultavimo nera. Taciau galima pradeti 
taikyti neformalq konsultavimq, kai vienas akademines 
bendruomenes narys padeda kitam”. O George atsake: 
„ls kolegos ateinantis grjztamasis rysys gali pasiteisinti, 
jei keli destytojai desto tq patj dalykq: tada jie stebi vie- 
nas kito uzsiemimus ir gali neformaliame pokalbyje pa- 
diskutuoti. Taciau tai turi buti laikoma konsultacija, o ne 
destytojq ataskaita administracijai”. 

George atvejis - tai pavyzdys, kaip katedra iesko bu- 
du pagerinti destymq. Bet be paramos katedros lygme- 
nyje, George ir kiti destytojai buvo palikti kiekvienas sau. 
Dauguma is jq norejo gauti grjztamqjj rysj. Jq diskusijoje 
kaip pagerinti destymq nebuvo kalbama apie kiekvieno 
destytojo atsakomybq padeti tobuleti kitiems. Tai buvo 
laikoma kiekvieno asmenine atsakomybe. 

Nepaisant to, kad George katedroje nebuvo jprasta 
manyti, jog profesine bendruomene gali pagerinti desty- 
mq, pasidare aisku, kad kolegos pasiruosq suteikti pa- 
galbq. Katedru ir aukstqju mokyklq vadovu atsakomybe 
yra keisti „zvaigzdziq sistemq" (tiek atliekant tyrimus, tiek 
destant) j bendradarbiaujanciq jmonq. 


5 

POLITINIS KONTEKSTAS 

Destymas yra gana individualus darbas, bet jo prasmq 
formuoja institucija. Nesvarbu, ar destytojas garsiai ar ty- 
liai palaiko universiteto politikq, ar jai priestarauja, jis dir- 
ba toje sistemoje, kurios laikosi universitetas. Taip buvo 
visada. 

Per visq universitetu istorijq universitetai buvo centrai, 
kuriuose vyko ziniq paieska del paciu ziniq. Taciau uni- 
versitetq jsipareigojimai studentams yra svarbesni. Jie ap- 
ima socialini pagrjstumq ir parengimq darbui. Vis delto 
baznycios, visuomenes klasiq, vyriausybes ir remejq ta- 
rybu tikslai lemia, kas destys, kq destys, ir kaip destys. 
Destymo kokybq is dalies apibrezia chartijos ir misijos 
vertybes. 

Rinkos ekonomikoje universitetai raginami skatinti ko- 
mercijq ir organizuotis j jq. Siandieniniai administratoriai 
raginami teikti pirmenybq programoms, skatinanccioms 
globaliq prekybq. Kai kurie universitetai finansiskai pri- 
klauso nuo studentu is tolimu saliu, kad apmoketq savo 
veiklos kastus. Galima daryti prielaid^, kad tai, kas buvo 
studijuojama praeityje, sekmingai pasitarnaus ir vieti- 
niams, ir uzsienio studentams, bet kai kurie destytojai gali 
ignoruoti naujo kulturinio pagrindo buvimq auditorijoje. 
Studentai vis dazniau susiduria su destytojais, kuriu poli- 
tines paziuros skirtingos, o dar dazniau skiriasi jq kalba. 
Ir visa tai vysta institucijai mazai aiskinantis, kokiq reiksmp 
tai turi destymo kokybei. 

Galbut didziausiq poveikj destymo jvertinimui turi pa- 
aukstinimo etika, labai akivaizdi siandieniniuose univer- 
sitetuose. Is universitetq ir akademinio personalo nariu 
reikalaujama pateikti dokumentus, patvirtinancius, koki^ 
param^ jie gauna ar kokiq noretu gauti, akademinio per- 
sonalo apdovanojimus ir pasizymejimo zenklus, kad islai- 


classes, and then they have an informal conversation. 
But this needs to be provided as consultation, not with 
professors writing reports for the administration.” 

George’s case provided an example of a department 
that expressly communicated its intentions to improve 
teaching. But with no support at the department level, 
George and other instructors were left on their own. Many 
of them wanted feedback. Their efforts to improve teach- 
ing did not include a discussion of the responsibility of 
each professor to help others improve. This was seen to 
be an individual responsibility. 

In spite of the fact the George’s department was not 
accustomed to thinking of instruction needing a commu- 
nity of practice, it was clear that some colleagueship was 
available. It is the responsibility of department and cam- 
pus leaders to change the perspective away from a star 
system (both in research and teaching) to become a col- 
laborative enterprise. 

5 

THE POLITICAL CONTEXT 

Instruction is highly personal but its meanings are shaped 
by the institution. Whether an instructor is a voice sup- 
porting, opposing, or mute to the political standing of the 
university, he or she teaches on a stage of what the uni- 
versity stands for. It has always been so. 

The history of the university has been one of scholar- 
ship with some search for knowledge for knowledge’s 
sake. The larger promise to students however is for so- 
cial legitimacy and preparation for work. But the purposes 
of church, class, government and patronage help deter- 
mine who shall teach and what and how they shall teach. 
Quality of teaching is partly defined by the values of char- 
ter and mission. 

In a market economy, universities are called upon 
to stimulate and subordinate to commerce. Administ- 
rators today are moved to favor programs facilitating 
global trade. Some universities increasingly rely on 
students from distant countries to pay campus operat- 
ing costs. It may be presumed that what has been 
taught in the past will serve domestic and international 
students well, but few individual instructors can ignore 
the new range of cultural backgrounds in the class- 
room. And students increasingly are faced with instruc- 
tors who share little political perspective and even less 
a common language with them. And all this with little 
guidance by the institution as to what it means in the 
way of teaching quality. 

Perhaps the greatest impact on evaluation of tea- 
ching is the ethic of promotionalism so visible on to- 
day’s campus. Schools and faculty members are called 
upon to present credentials that justify the support they 
are getting or new support they want to get. In the name 
of evaluation, but not the spirit, administrators are re- 
quired to, and offer to, count the accolades and honors 
of their faculties to maintain status or support new ini- 
tiatives. Following the ethics of advertising, not of pure 
and applied research, the institution and instructor are 
expected to boast of their assets and to be quiet about 
their debits. 
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kytu turim^ status^ ar paremtLj naujas iniciatyvas. Kaip 
reikalauja reklamos etika, o ne fundamentals ir taiko- 
mieji tyrimai, institucijos ir destytojai turi girtis savo pra- 
nasumais ir nutyleti trukumus. 

Destymo jvertinimas jpinamas i jvairiarusiq misijq po- 
litinj rebusq. Kam reiketq teikti pirmenybg - savo vertes 
isaukstinimui ar savo darbo tyrimams? Svarbus abu as- 
pektai, taciau sqziningq jvertinimq silpnina politinis ko- 
rektiskumas. S^ziningo jvertinimo palaikymas per retai 
girdimas universitetu ir katedrq vadovq pasisakymuose. 

5.1. TIKSLAI 

Destymo bei kitq svietimo sistemos aspektq jvertinimui 
reikalingi jvertintojai, kurie galetq analizuoti siekiamus tiks- 
lus. Politiniu poziuriu, kiekviena katedra turi savo mece- 
natus ir klientus ir jiems yra jsipareigojusi. Administrato- 
riq atsakomybe 27 - yra interpretuoti bendruomenes no- 
rus ir studentq poreikius, ir tuo remiantis sudaryti forma- 
lius destymo planus. 

Administratoriai atsakingi uz katedros tikslu, ypac il- 
galaikiq, taip pat studijq turinio tikslq formalizavimq. At- 
skiri destytojai savo zodziais ir veiksmais kelia tarpinius 
ir taktinius tikslus, atsizvelgdami j ideologijq, socialinp mi- 
sijq ir politinp realybp. Varzomi paprociu ir polinkio, des- 
tytojai pasirenka strategijq ir taktikq. Studijq programq 
turinio integralumas islaikomas tik tada, kai akademinis 
personalas suvokia, kad yra laisvas nustatytose ribose ir 
esanttam tikram darbo pasidalijimui siekti katedros tiks- 
lq taip, kaip kiekvienas mano esant tinkama (Peters ir Wa- 
terman, 1984). 

Uz jvertinimq atsakingi vadovai ir komitetai turetq 
vertinti tokios atsakomybes realizavimq, bet neturetq 
manyti, kad yra vienintelis tinkamas destymo budas ar- 
ba kad egzistuoja vienintelis studijq tikslq kompleksas 
net ir vienai paskaitai. Jie turetq supazindinti destytojq 
su tarn tikromis sampratomis ir praeities indelio verti- 
nimu bei tarn tikrais lukesciais, taciau, remiantis tuo, 
kq mes zinome apie destymq, galutinis tarpiniq tikslq 
ir destymo priemoniu pasirinkimas turetq buti paliktas 
tarn, kuris desto. 

Pagrindine administracijos personalo atsakomybe 
yra palaikyti pagyrimo vertq destymq. Administratoriai 
turetq rinkti nuopelnq jrodymus ar ju nebuvimq is visq 
saltiniq. Jie turetq kreipti demesj ir j studento vertinimo 
procesus bei rezultatus, bent neformaliai tqsti tyrimq apie 
savo absolventq pasiekimus. Visq laikq jie turetq atsar- 
giai skatinti kiekvienq akademinio personalo narj forma- 
liai ir neformaliai pateikti jrodymus apie savo destymo 
nuopelnus. Be to jie turetq pateikti planus ir destymo 
produktus kruopsciam dalyko ir didaktikos ekspertq ver- 
tinimui. 

Kiekvienas zmogus, kuris desto, yra atsakingas uz 
destymo efektyvumo jrodymus. jrodymu gali buti „pro- 
ceso“ ar „produkto” duomenys, o geriausiu atveju abie- 
ju rusiq duomenys. Proceso duomenys (pvz., paskaitq 
planai, konsultavimas, savgs jvertinimas) yra naudingi, 
nes mes tikime, jog tarn tikri destymo ypatumai skatina 
studentq laimejimus (Marton ir Saljo, 1976). Pavyzdziui, 
tiketina, kad akivaizdus demesys etinei elgsenai audito- 
rijoje padrqsins jaunimo etinp elgsenq. Produkto duome- 
nys apie galutinj rezultatq-tai realiq laimejimq jrodymai 
ir laimejimq koreliatai (pvz., pazangumo rezultatai netie- 


The evaluation of teaching is caught in a political 
conundrum of mixed messages. Should self-aggrandize- 
ment or self-study be the dominant theme? There will 
be both, but honest evaluation is weakened by political 
correctness. Advocacy for honest evaluation is too sel- 
dom apparent in the words of campus and department 
leaders. 

5.1. GOALS 

The evaluation of teaching, as with evaluation of other 
aspects of the educational system, needs evaluators 
who can analyze goals. As part of its political land- 
scape, every department has patrons and clients to 
whom it has commitments. It is the responsibility of 
administrators 27 to interpret the wishes of the commu- 
nity and the needs of students and thus to shape a 
formal curricular plan. 

Administrators have the responsibility to formalize 
department goals, particularly long range curricular goals. 
In words and in action, attendant to ideology, social mis- 
sion, and political realities, individual instructors set in- 
termediate and tactical goals. Within constraints of cus- 
tom and taste classroom instructors choose strategies 
and tactics. The integrity of a curricular program is 
maintained only when faculty members perceive them- 
selves - within limits and a certain division of labor - to 
be free to pursue department goals as each sees fit (See 
Peters and Waterman, 1984). 

Supervisors or committees charged with evaluative 
responsibility should assess the discharge of such re- 
sponsibility but should not presume that there is but one 
proper way of teaching or that there is but one set of 
educational objectives, even for a single lesson. They 
may make known to the instructor certain perceptions 
and valuation of past contributions and certain hopes 
for the future, but - based on what we know about teach- 
ing - the final choice of intermediate goals and means 
of instruction should largely be left to the one who 
teaches. 

Maintaining meritorious teaching is one of the primary 
responsibilities of the administrative staff. The adminis- 
trators should collect evidence of merit - or lack of it - 
from various sources. They should give some small at- 
tention to processes and outcomes of student assess- 
ment and should at least informally follow-up former stu- 
dents. Throughout the year and across the years, with 
sensitivity, they should encourage each faculty member 
formally and informally to submit evidence of teaching 
merit. Together they should submit plans and artifacts of 
teaching to the scrutiny of experts in subject matter and 
pedagogy. 

Each person who teaches is responsible for contri- 
buting to the evidence of effectiveness of teaching. The 
evidence may be “process” or “product” data, preferably 
both. Process data (e.g., lesson plans, counsel, self-evalu- 
ations) are useful because we believe that certain tea- 
ching activities promote student accomplishment (Marton 
& Saljo, 1976). For example, it is expected that a con- 
spicuous concern for ethical behavior in the classroom 
will encourage ethical behavior in youth. Product data 
provide actual observation of accomplishment or corre- 
lates of accomplishment (e.g., achievement tests indi- 
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siogiai rodo, kad studentai supranta tam tikrus svarbius 
santykius). Is pradziu gali pasirodyti, kad duomenys apie 
galutinj rezultatq reikalingi labiau, taciau poreikis vertinti 
darbo sqlygq kokybg ir studentq pasiekimLj priskyrimo 
destytojo nuopelnams sudetingumas reikalauja ir proce- 
siniq duomenu. 

5.2. ATSAKOMYBES PERDAVIMAS DESTYTOJAMS 
Kadangi autonomija yra ne tik realus faktas, bet ir jrodyta 
jos svarba geram darbui, 28 priemones, kurias administ- 
ratoriai gali taikyti destymo programij pertvarkai, turetq 
buti ir yra ribotos. Daugeliu atveju uzmokestis uz nuopel- 
nus nera siulomas, o uzduociu modifikavimas gana su- 
varzytas. Vis delto administratoriai gali modifikuoti des- 
tymo kryptj jtikinedami, perskirstydami atsitiktinius istek- 
lius ir darbo kruvj, atsakomybq ir kartais jdarbindami asis- 
tentus ar net naujus akademinio personalo narius. 

Patys destytojai atsakingiausi uz nuolatinj savo des- 
tymo tobulinimq. Administratoriai atsakingi uz sito tobuli- 
nimo skatinimq ir paramq jam. Universiteto tarnybos tu- 
retq teikti sias priemones savanoriskam, o kartais ir kon- 
fidencialiam naudojimui: 

(1) auditorijq, laboratoriju ir praktikos darbu vietu buk- 
les, kuri, kaip jrodyta, turi jtakos studijoms, aprasus; 

(2) kursoturinio apzvalgq (temu, tekstu, literaturos rin- 
kinius ir 1. 1.), kurias atliko patyrg kolegos ir specialiai pa- 
rengti Siam darbui vadovai ir; 

(3) destymo ir testavimo specialistq paslaugas ste- 
bejimui ir darbo gerinimui. 

Griztamasis rysys del siq trijq saltiniu panaudojimo 
daugiausia jtakos turetu tuo atveju, jei butq atliekamas 
ilgq laikq (kaip ir deretq demokratinese visuomenese) ir 
butq laikomas atskiro destytojo nuosavybe, be jo kiti ko- 
legos negaletu sia informacija pasinaudoti. 

Studijq programq verte ne visiskai, bet bent is dalies 
priklauso nuo jos poveikio studentams. Taciau sj poveikj 
sunku jvertinti. Todel dalj destymo jvertinimo turetq su- 
daryti studentq mokymosi vertinimas. Kokie nors gebeji- 
mu jgijimo jrodymai, supratimas ir poziuris gali buti verti- 
nami neformaliu budu, taciau gali buti vertinami irforma- 
liai sistemingo stebejimo ir kontroliniq darbq atlikimo me- 
todais, arba kiek maziau veiksmingais budais - pasieki- 
mu testais ir interesq bei poziurio tyrimo inventoriais. Mi- 
netos priemones turetq buti laikomos tik kaip pasiekimu 
visumos vertinimo elementais. 

Siame straipsnyje destymo jvertinimas aptartas ak- 
centuojant darbo kontekstq, kompetentingumo daugia- 
lypiskumq ir atskiru destymo proceso dalyviu unikalumq. 
Sios savybes kartu su asmenine motyvacija ir empatiniu 
supratimu laikomi bendraisiais naturalistiniu, fenomeno- 
loginiq ir etnografiniq destymo tyrimq aspektais. 29 Tyri- 
mo metodai, taikomi tokiuose tyrimuose, padeda gerinti 
tobulejimo pastangq kokybp. 

Is visq keturiu destymo jvertinimo tikslq ne vienas ne- 
ra svarbesnis uz ilgalaikg paramqtgstiniam destytojo kva- 
lifikacijos tobulinimui. Savarankiskos studijos ir karjeros 
pletote turi buti vykdomi kaip jsipareigojimas institucijos 
tikslams zinant esamas destymo sqlygas ir numatant al- 
ternatyvios didaktikos taikymo rezultatus. Aukstoji mo- 
kykla turetq formuoti profesinj tobulejimq palaikanci^ ap- 
link^, is dalies periodiskai atlikdama politines aplinkos 
apzvalgq, kur atsizvelgiama j destymo proceso tyrimus ir 


rectly indicate students do understand certain important 
relationships). Product data at first appear preferable, but 
need for assessing the quality of working conditions and 
the difficulty of attributing student achievement to what 
the instructor does make inclusion of process data a ne- 
cessity. 

5.2. LEAVING TEACHERS IN CHARGE 
Because autonomy is not only a fact of life but a demon- 
strated contribution to good work, 28 the means available 
to administrators for redirecting instructional programs 
are and should be limited. In many places, merit pay is 
not offered and modification of assignment is greatly 
constrained. Still administrators can modify the direction 
of teaching through persuasion, by reallocation of inci- 
dental resources and class load, by reassignment of re- 
sponsibility, and sometimes by employment of aides or 
even additional faculty members. 

The instructors themselves are mainly responsible for 
the continuing improvement of instruction. Administrators 
are responsible for encouragement and facilitation of that 
improvement. The following should be provided by cam- 
pus services for voluntary, sometimes confidential, use: 

(1) checklists of classroom, laboratory, and field condi- 
tions which have been demonstrated to promote learning; 

(2) course-content reviews (selections of topics, texts, 
resource works, etc.) conducted outside the classroom by 
experienced peers and specially trained supervisors; and, 

(3) observational and remediation services by spe- 
cialists in instruction and testing. 

Feedback from these three sources will work best in 
the long run if seen (as, in democratic societies, it should 
be) as the property of the individual instructor, not to be 
reviewed by others without his/her release. 

The worth of an educational program is not entirely 
but at least partly attributable to its impact on students. 
Impacts are difficult to measure. A part of the evaluation 
of teaching should be an attempt to assess student learn- 
ing. Some indication of gain in skill, understanding, and 
attitude can be obtained informally, but also formally 
through disciplined observation and performance tests, 
and to a lesser extent with achievement tests and inter- 
est and attitude inventories. These measures should be 
seen as merely sampling a full set of achievements. 

In this paper, the evaluation of teaching has been dis- 
cussed with emphasis on the context of work, the 
multidimensionality of competence, and the uniqueness 
of individual faculty members. These qualities — plus 
emphasis on personal intentionality and empathic under- 
standing — have been common aspects of naturalistic, 
phenomenological, and ethnographic studies of teach- 
ing. 29 Inquiry methods used in such studies have a po- 
tential for enhancing the quality of appraisal efforts. 

Of the four purposes of evaluation of teaching, none 
is more important than long-range support of an instruc- 
tor’s continuing education. Self-study and career devel- 
opment need to be undertaken with a commitment to in- 
stitutional goals, awareness of existing instructional con- 
ditions, and a certain expectation of the results of alter- 
native pedagogies. The campus should provide a sup- 
portive environment for professional growth, partly by 
making periodic review of the political environment, at- 
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uztikrinama, kad bus pateikiami sqziningi (nors ir subjek- 
tyvus) sprendimai apie destymo kokybp, Administraci- 
jos pareiga jvertinimq sumanyti ir atlikti taip protingai, kad 
atskiras destytojas po tokio jvertinimo jaustusi daug la- 
biau informuotas ir dar savarankiskesnis ir atsakingesnis 
uz destymq nei anksciau. 


1 Saltinis: ERIC Thesaurus. Internetinis adresas: http://www. 
ericfacility.net/extra/pub/thessearch.cfm 

2 Saltinis: Stake R. 1 999. The representation of quality in evalu- 
ation. Paper presented at the Annual Meeting of the American 
Educational Research Association, Montreal, Canada, April. 

3 Saltinis ERIC Thesaurus. Internetinis adresas: http://www. 
ericfacility.net/extra/pub/thessearch.cfm 

4 Saltinis Scriven, M. (1991). Evaluation Thesaurus, Newbury 
Park, CA: SAGE 

5 Saltinis ERIC Thesaurus. Internetinis adresas: http://www. 
ericfacility.net/extra/pub/thessearch.cfm 

6 Sunku tiketis, kad administracija ar akademinis personalas, 
jauciantys jtampq darbe, gins akademinq laisvq. Gana trikdantj 
aprasymq kolegijos destymo lygmenyje pateikia Ellen Schrec- 
ker studijoje No Ivory Tower: McCarthyism and the Universities 
(Ne sme/io piiys: McKartizmas ir universitetai). 

7 Panagrinekime kriterijq „visada kruopsciai isaiskina”. Jis skam- 
ba gerai, bet, kaip primena isradejas Edwin Land, kai kurie des- 
tytojai aiskina per daug, o galetq bent retkarciais parodyti nu- 
stebimq (Beckman paskaita, lapkricio 21 d., 1985, llinojaus uni- 
versitetas). 

8 Kaip matyti tokiq teiginiq kaip „zinojimas, destymas ir vadova- 
vimas”, Hunter poziuris j destymq platus ir sudetingas. Arthur 
Costa reaguodamas j kritika teigia, kad Hunter poziuris vercia 
zmones galvoti apie techniskqjq destymo pusq. Abi idejos spaus- 
dinamos ASCD leidinyje Using What We Know About Teaching 
(Taikymas to, ka zinome apie destymq), 1 984. 

9 Daug metij destytojai koneveike ir kritikavo studentq atliktus 
destymo vertinimus kaip subjektyviq ir nezinojimu paremtq nuo- 
monq. 1969 m. llinojaus universiteto CRUEL komitetas, kuriam 
vadovavo Richard Anderson, atidziai isnagrinejo mokslinq lite- 
rature ir jrode, kad studentq sudaromi destymo reitingai, nors 
subjektyvus ir remiami ribotomis ziniomis, bet yra pagristi ir efek- 
tyvus. Jis tiek pat validus ir siuo metu. Dabar studentq numone 
labiau toleruojama, o kartais net gana rimtai vertinama. 

10 jmantriausios mokymosi vertinimo priemones aukstojoje mo- 
kykloje yra gabumq mokytis vertinimo priemones, o ne jgytq 
pasiekimq jvertinimo priemones. Jos ganatiksliai nustato, kurie 
studentai daugiausiai ismoko per praejusius metus, o kurie dau- 
giausiai ismoks ateityje, bet negali nustatyti, kiek efektyviai da- 
bartinis kursas buvo isdestytas (Stake, 1995). 

" Juose retai rasite isvardytus netinkamo elgesio kriterijus, ne- 
bent turimas tikslas sudaryti formaliq atskiro atvejo studijq apie 
destytojq. 

12 Pasak Seldin (1993), beveik visos kolegijos ir universitetai 
Jungtinese Amerikos Valstijose sudaro ir taiko studentq reitin- 
gus destymui jvertinti. 

13 Pareigybineje destytojo jvertinimo metodikoje kiekvienoje is 
isvardytq dimensijq reikalaujama tik minimaliq pasiekimq. Re- 
miantis daugiau kaip vienu jrodymq saltiniu, destytojas „turi pro- 
gq atsakyti j visus parodymus . . . ir apskqsti bet kurj sprendimq” 
(p. 34). Pastovus reiksmingi netikslumai laikomi korekcijos fak- 
toriumi ir saliskumo akivaizdumo jrodymu. (rodymais vadiname 


tending to the findings of research on instructional pro- 
cesses, and insuring honest (though subjective) judg- 
ments of teaching quality. It is an administrative obliga- 
tion usually best discharged by evaluation so cleverly 
devised that the individual instructor is left better informed 
and even more in charge of instruction than before. 


1 Source: ERIC Thesaurus. Available online: http://www. 
ericfacility.net/extra/pub/thessearch.cfm 

2 Source: Stake, R. 1999. The representation of quality in evalu- 
ation. Paper presented at the Annual Meeting of the American 
Educational Research Association, Montreal, Canada, April. 

3 Source: ERIC Thesaurus. Available online: http://www. 
ericfacility.net/extra/pub/thessearch.cfm 

4 Source: Scriven, M. (1991). Evaluation Thesaurus, Newbury 
Park, CA: SAGE 

5 Source: ERIC Thesaurus. Available online: http://www. 
ericfacility.net/extra/pub/thessearch.cfm 

6 Administrators and faculties under pressure cannot be counted 
on to protect academic freedom. For college-level teaching, an 
embarrassing portrayal is Ellen Schrecker’s study, No ivory 
Tower: McCarthyism and the Universities. 

7 Take the criterial item “always explains things thoroughly.” It 
sounds good, but inventor Edwin Land reminds us that some teach- 
ers explain too much, needing occasionally to just show wonder. 
(Beckman Lecture, November 21 , 1985, University of Illinois.) 

8 As revealed in such statements as “Knowing, Teaching, and 
Supervising” Hunter has a broad and complex view of teaching. 
Yet as pointed out in a rejoinder by Arthur Costa, Hunter’s views 
draw people to thinking of the technical side of teaching. Both 
appeared in the ASCD publication Using What We Know About 
Teaching, 1984. 

9 For many years student ratings of instruction were berated by 
professors as subjective and unknowing. A 1969 University of 
Illinois CRUEL Committee chaired by Richard Anderson care- 
fully examined the research literature and found, though sub- 
jective and based on limited knowledge, student ratings had a 
substantial validity. Probably just as valid today, student ratings 
of instruction are now widely tolerated, even sometimes taken 
quite seriously. 

10 The most sophisticated measures of college learning are 
measures of aptitude to learn, not measures of attained achieve- 
ment. They indicate rather accurately which students have 
learned the most in past years and who will learn the most in the 
future, but they do not tell how effectively the present course 
has been taught (Stake, 1995) 

11 Seldom is there any listing of impropriety unless it has been 
decided that a formal case is to be made against the professor. 

12 According to Seldin (1993) nearly all colleges and universi- 
ties in the United States collect and use student ratings of in- 
struction. 

13 In the Duties-Based-Teacher Evaluation Approach, a minimum 
level of achievement is required on every one of the listed di- 
mensions. Teacher performance is measured using more than 
one source of evidence, and the teacher “has the opportunity to 
respond to all evidence... and to appeal against any decision.” 
(p. 34). Consistent and significant inaccuracies are used as a 
correction factor and a evidence of bias. Evidence involves judge- 
ments, records, observations, test data, teacher portfolios and 
footprint data. 
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sprendimus, uzrasq protokolus, stebejimq, testq duomenis, des- 
tytojo aplankus ir pastabq duomenis. 

14 Scriven kiekvienq kategorijq laiko dimensija arba kriterijumi, 
kuris apibudina destytojo darbq. Jis sukure sj sqrasq perziurejqs 
daugybq oficialiq dokumentu. Sis sqrasas veliau buvo pateiktas 
patyrusiems destytojams is JAV, Kanados ir Australijos, kad jie 
patikrintg, parengtq savo reakcijqir pateiktq pasiulymus (p. 25). 

15 Kaip teigia Doyle (1982), „... atrodo visiskai nejmanomas da- 
lykas, kad koks nors charakteristikq rinkinys vienodai tiktq visq 
rusiq medziagos isdestymui jvairiems studentams jvairiais atve- 
jais ... net bandyti parengti tokj sqrasq gana rizikinga” (p. 27). 

16 Tai kelia rimtq problemq, nes „svarbiausia pagrjstumo proble- 
ma yra prasmes ir pasekmiq vertinimas” (Messick, p. 14). 

17 Mesdamas issukj destytojui, kuris kritikavo destymo siuolaiki- 
neje aukstojoje mokykloje jvertinimq, Michael Theall pasinau- 
dojo Robert Ebel citata (1983, p. 65): „Jokiam universitetui ne- 
reikalingas destytojas, kuris kritikuoja studento jvertinimus, ne- 
pakankamai arba visiskai neisanalizavps atliktq tyrimp, ... kurie 
sudaro praktikos pagrindq, gausos”. Tokie jvertinimo tyrejq, ku- 
rie kartu yra ir destytojq jvertinimo administratoriai, pateikiami 
issukiai - jprastinis dalykas. Bet toje tyrimu gausoje, kuriq mine- 
jo Ebel, dazniausiai labai siaurai jvertinamas studentq poziurio 
patikimumas ir pateikiami ne visi destymo nuopelnai. O tai taip 
pat yra saliskumas. 

18 Mus sujaudino Tolstojaus romano Ana Karenina moralas, ne- 
laimingos meiles istorija, kuri baigiama teiginiu, kad isskirtinis 
zmogiskos sqmones bruozas yra jos gebejimas atskirti gerj ir 
blogj ne kaip atrastas ar apskaiciuotas zinias, ne kaip neklysta- 
mas ir ne visada pasiekiamas, bet jsisaknijusiais ir tobulejan- 
cias su kiekvieno zmogaus patirtimi (p. 830 ir p. 835): 

Fiodoras sako, kad Kirilovas gyvena savo pilvui. Tai supran- 
tama ir racionalu. Visi mes, kaip protingos butybes negalime 
padaryti nieko kito, tik gyventi savo pilvui. Ir staiga tas pats Fio- 
doras pareiskia, kad neteisinga gyventi vien savo pilvui: mes 
privalome gyventi tiesai, Dievui, ir tos uzuominos man pakanka, 
kad suprasciau, kq jis nori pasakyti! Ir milijonai zmoniq, kurie 
gyveno pries simtus metq ir gyvena dabar - valstieciai, skurdus 
savo dvasia ir ismintimi, tie, kurie mqste ir apie tai rase savo 
miglotais, sunkiai suprantamais zodziais kartodami tq patj - mes 
visi pritariame siai minciai: del ko mes turetume gyventi ir kas 
yra geris. As ir visi zmones turime tik kalbq, kuri yra tvirta, nenu- 
gincijama ir aiski, ji negali buti paaiskinta protu: ji neturi priezas- 
ciq ir negali tureti pasekmip . . . 

Guledamas ant nugaros, jis zvelge aukstyn j giedrq dangp. 
„Negi as nezinau, kad tai begaline erdve, o ne apvalus kamuo- 
lys? Taciau kad ir kiek stengciausi jsmeigti zvilgsnj ir jtempti akis, 
negaliu pamatyti nieko kito, kaip tik apvalq ir ribotq apskritimq, 
nepaisantto, kad zinau, jog tai begaline erdve. As nenugincija- 
mai teisus, kai nuolat matau melynq skliautq, daug teisesnis nei 
bandydamas jtempti zvilgsnj ir pamatyti, kas yra uz sio skliauto. 

19 Daug svarip tyrimp atlikta sioje plotmeje. Daugelyje tyrimp ana- 
lizuojamas destymo efektyvumas informacijos metodp ir salti- 
niq atzvilgiu, ypac pasitelkiant studentus kaip vertintojus (Kin- 
ney ir Smith, 1992: Braskamp, Brandenburg, Ory, 1984; Cas- 
hin, 1988; Marsh, 1987; El-Flassan, 1995). 

20 Profesine bendruomene gali buti apibrezta kaip „grupe profe- 
sionalp, neformaliai susijusiq vienas su kitu, susidurianti su ben- 
dromis akademinio darbo problemomis ir siekiant rasti jp spren- 
dimus, tokiu budu praturtinti save naujomis ziniomis” (Peter ir 
Trudy Johnson-Lenz, 1998). Profesines bendruomenes kildina- 
mos is Europos gildijp laikp, bet kai kurie autoriai teigia, kad jos 
tokios senos kaip ir bet kuri bendra zmoniq veikla ( Community 
Intelligence labs, 1 998) . 

21 Aferavkompanijoje John Seely Brown atrado netiketq budp, 
kaip priversti savarankiskai dirbancius, labai nenoriai bendrau- 
jancius fotokopijavimo masinq remontininkus kalbetis vienas su 
kitu apie vis kintancius kopijavimo masinq modelius. Mes, auks- 
tpjq mokyklp destytojai, turbut esame tokie pat saunus kaip ir 


14 Scriven treats each category of data as a dimension, or a 
criterion that defines an instructor's job. Fie developed the list 
by conducting a review of numerous official documents that was 
later presented to experienced teachers in the U.S., Canada and 
Australia for their reaction and suggestions to the items of the 
list (p. 25). 

15 As Doyle (1982) mentions, “... it seems most unlikely that any 
one set of characteristics will apply with equal force to teaching 
of all kinds of material to all kinds of students under all kids of 
circumstance... to try to prepare such a list entails substantial 
risk” (p. 27). 

16 This constitutes a serious problem since “the central issue in 
validity is the appraisal of meaning and consequences.” 
(Messick, p. 14) 

17 Challenging an instructor who criticized contemporary evalu- 
ations of college teaching, Michael Theall used Robert Ebel’s 
quote (1983, p. 65) “No corner of the university lacks faculty 
members who fulminate against student evaluations, with little 
or no examination of the large body of research ... that underlies 
the practice.” Such challenges are common by evaluation re- 
searchers who are also administrators of faculty evaluation sys- 
tems. But that body of research Ebel referred to mostly looks 
narrowly at the reliability of representing student views, not so 
much at full representation of merit in teaching. This too is a 
bias. 

18 We were drawn to the moral of Tolstoy's story of Anna Karenin, 
a story of star-crossed love but concluding with the claim that 
the distinguishing characteristic of human consciousness is its 
ability to know good and bad, not as discovered or calculated 
knowledge, not as infallible and not always accessible, but in- 
grained and evolving in each person’s experience. From pages 
830 and 835: 

Fiodr says that Kirilov lives for his belly. That is intelligible 
and rational. All of us as rational beings can’t do anything else 
but live for our bellies. And all of a sudden this same Fiodr de- 
clares that it is wrong to live for one’s belly; we must live for 
truth, for God, and a hint is enough to make me understand 
what he means! And I and millions of men, men who lived cen- 
turies ago and men living now — peasants, the poor in spirit and 
the sages, those who have thought and written about it, in their 
obscure words saying the same thing — we are all agreed on 
this one point: what it is we should ive for and what is good. 
Then only knowledge I and all men possess that is firm, incon- 
testable, and clear is here, and it cannot be explained by rea- 
son: it has no causes and can have no effects. . . . 

Lying on his back, he was now gazing high up into the cloud- 
less sky. “Do I not know that that is infinite space, and not a 
rounded valult? But however much I screw up my eyes and strain 
my sight I cannot see it except as round and circumscribed, 
and in spite of my knowing about infinite space I am incontest- 
ably right when I see a firm blue vault, far more right than when 
I strain my eyes to see beyond it. 

19 A substantial body of research has been conducted along 
this line of inquiry. Most of the research has focused on meth- 
ods and sources of information regarding teaching effectiveness, 
especially on the use of students as raters. (Kinney and Smith, 
1992; Braskamp, Brandenburg & Ory, 1984; Cashin, 1988; 
Marsh, 1987; El-Flassan, 1995). 

20 A community of practice can be defined as “a group of pro- 
fessionals, informally bound to one another through exposure 
to a common class of problems, common pursuit of solutions, 
and thereby themselves embodying a store of knowledge.” (Pe- 
ter & Trudy Johnson-Lenz, 1998). Communities of practice have 
been traced back to the European guilds, but some writers see 
them as old as human interactivity of any kind (Community In- 
telligence labs, 1998). 

21 At Xerox, John Seely Brown found unexpected ways for au- 
tonomous, greatly-reluctant photocopy repairmen to talk with 
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tie remontininkai, tad turetume rasti budq, kaip kartu sprqsti des- 
tymo problemas ir suderinti destymo auditorijoje jvertinimq su 
destymo veiklos visoje katedroje palaikymu irtobulinimu. 

22 „Mokymasis nera vien tik veikla, tai ir bendravimo su kitais 
priemone. Mokymasis yra socialinis reiskinys. Mes visi priklau- 
some profesinems bendruomenems (darbe, mokykloje ar as- 
menineje veikloje). Ir butent budami sip bendruomeniq nariais 
pleciame savo zinias, o sis zinojimas suteikia mums galios. So- 
cialinis pasaulis yra ten, kur vyksta darbas ir mokymasis. Desty- 
tojus supa visas tarpusavy susijusip profesinip bendruomenip 
ansamblis, kurio ribos nebutinai (ar paprastai) sutampa su for- 
maliomis organizacijp ribomis” (Alpert, 1998). 

23 „Stiprioje katedroje prioritetas teikiamas kolektyviniams spren- 
dimams del to, kq reikia atlikti. Kiekvienas narys turi savo priori- 
tetus, bet, atsizvelgiant j katedros misijq, tuos prioritetus kartais 
tenka perskirstyti. Kai kurie katedros nariai jnesa ypatingq indelj 
j kolegialumo atmosferos kurimq ir bendro tikslo siekimq, do- 
medamiesi eiliniais katedros reikalais, o ne siekdami tapti reiks- 
mingi salies mqstu. Ismintingos institucijos pripazjsta ir remia 
atsirandancias profesines bendruomenes» (Alpert, 1998). 

24 Loomis pripazjsta individualp darbq, bet taip pat didelj deme- 
sj skiria toms savybems, kurios telkia bendruomenq. Jis pateike 
sqrasq, kuriame destytojai sugrupuoti pagal jp asmeninj indelj j 
katedros veiklq. Vienu metu sqraso virsuje buvo atsidurgs No- 
belio premijos laureatas. Ten jis atsidure ne del savo isskirtinio 
intelekto, o uz nejkainojamq paramq padedant kitiems katedros 
nariams (Alpert, 1998). 

25 George atvejo studija yra vidinio tyrimo „Studentp reitingp re- 
zultatai ir jp galimas poveikis destymo pagerinimui” dalis. Siek- 
dami uztikrinti konfidencialumq, vietoj tyrime dalyvaujancios ka- 
tedros pavadinimo, akademinio personalo ir katedros vedejo pa- 
vardzip ir vardp vartojome pseudonimus. 

26 „Paprastai kurso, kurj desto keli skirtingi destytojai, vertinimo 
rezultatai nebuna geri. Kadangi kursas privalomas, be to susi- 
jgs su matematika, vertinimai dazniausiai buna ne aukstesni nei 
butp kitp kursp. Vertinant kitus kursus, studentams pateikiamas 
platesnis atsakymp j klausimus diapazonas ir jskaitomas dau- 
giau nei vienas atsakymas. J analitinj mqstymq orientuoto kurso 
vertinimuose atsakymai siauresnes apimties. Dazniausiai atsa- 
kymas yra teisingas arba klaidingas. Tarpinip variantp yra ma- 
ziau” (Dr. Edwards, vienas is George kolegu). 

27 Nustatinedami jvertinimo atsakomybg vienus zmones pava- 
dinsime administratoriais, o kitus destytojais. Aisku, kad visi 
destytojai turi vykdyti administravimo pareigas, o kai kurie ad- 
ministratoriai yra akademinio personalo nariai. Vis del to tai 
nereiskia, kad administravimo ir destymo atsakomybe bus pri- 
skirta atskiriems zmonems. Patogumo tikslais mes cia supap- 
rastinsime abu vaidmenis: administravimq ir destymq. Taigi des- 
tytojai, priklausantys komitetams, yra ir administratoriai, ir des- 
tytojai. 

28 Daugelis autorip autonomijq laiko kliutimi gerinti mokyklos dar- 
bq, taciau Donald Schon pasitelkdamas argumentus iliustruoja 
autonomijos nuopelnus knygoje The Reflective Practitioner 
(1982) (Mqstantis specialistas). 

29 Zr. pvz., Terry Denny Some Still Do (1978) (Kai kurie vis dar 
taip darn) ir Louis M. Smith ir Keith L. Geoffrey, The Complexi- 
ties of an Urban Classroom: An Analysis Toward General Theo- 
ry of Teaching (1968) ( Miesto auditorijos sudetingumas: del 
bendrosios destymo teorijos anaiizes) . 


each other about fixing ever-changing models of copiers. We 
college teachers are probably as smart as they. We should find 
collective ways of addressing our teaching problems. And con- 
necting the evaluation of classroom teaching with the mainte- 
nance and repair of departmental instruction. 

22 “Learning is not only an activity, but also a vehicle for en- 
gagement with others. Learning is a social phenomenon. We all 
belong to communities of practice (work, school, in personal 
activities). It is through membership in communities of practice 
that we come to know - and become empowered by what we 
know. The social world is where work gets done, where learning 
takes place. Instructors encompass an ensemble of intercon- 
nected communities of practice whose boundaries do not nec- 
essarily (or usually) follow the formal boundaries of the or- 
ganization” (Alpert, 1998). 

23 “In a strong department, a high priority is given to collective 
decisions about what needs to be done. Each member has her 
own priorities but reallocation of priorities is needed when re- 
considering the mission of the department as a whole. Some 
members of a department make unique contributions to 
collegiality and shared purpose, attending to the local scene 
rather than to gaining national prominence as individuals. Wise 
institutions recognize and support emerging communities of 
practice.” (Alpert, 1998). 

24 Loomis recognized individual professional performance but 
also placed great value on qualities that held the community 
together. The Loomis List ranked individuals in terms of indi- 
vidual contribution to the department. At one time, at the top of 
the list was a Nobel Prize winner, so placed not for intellect but 
for his powerful contributions to other members of the depart- 
ment. (Alpert, 1998). 

25 George’s case is part of an internal study: “Trade-Offs: The 
use of student ratings results and its possible impact on instruc- 
tional improvement." In order to ensure confidentiality, pseudo- 
nyms were used to replace the names of the departments, fac- 
ulty members and department head involved in the case study. 

26 “In general, the course, which is taught by a number of differ- 
ent faculty members, does not receive good ratings. Since the 
course is required and is mathematically oriented, ratings are 
not typically as high as they might be in other courses. In other 
courses, students might have some latitude in their response to 
a particular situation. More than one response might be accept- 
able. In an analytically oriented course, there is much less lati- 
tude. An answer is usually either right or wrong. There are fewer 
shades of gray” (Dr. Edwards, one of George’s peers). 

27 To identify evaluation responsibilities here, it is desirable to 
call some people administrators and others teachers. Obviously 
all teachers have administrative responsibility and some admin- 
istrators are members of the instructional staff. It is not implied 
that administrative and instructional responsibilities should be 
assigned to separate people. For convenience here we over- 
simplify the two roles: administration and teaching. Thus, teach- 
ers on committees are administrators as well as instructors. 

28 Many writers treat autonomy as a barrier to school improve- 
ment, but its merit is well argued and illustrated by Donald Schon 
in The Reflective Practitioner (1 982) . 

29 See, for example, Terry Denny’s Some Still Do (1978) and 
Louis M. Smith and Keith L. Geoffrey, The Complexities of an 
Urban Classroom: An Analysis Toward General Theory of Teach- 
ing (1968) . 
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